You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Although this doesn't solve the bug if you would like to get things working and disable vllm from trying to use your integrated Radeon Graphics you can set CUDA_VISIBLE_DEVICES=-1. I tried setting --device=cpu and it is working correctly for me.
Your current environment
🐛 Describe the bug
Starting using
--device 'cpu'
throws CUDA error. Should run on CPU anywaysThe text was updated successfully, but these errors were encountered: