We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi,
When I specify device=cuda I get an error saying cpu and cuda devices are in use?
I can see that in generate.py .to(device) is being called in inputs and model so not sure why this is happening.
The text was updated successfully, but these errors were encountered:
Can you specify which script/function you are running? And I can help solve this
Sorry, something went wrong.
@arjunsbalaji - When running from Python, you can run the following command to set the default Torch device:
import torch torch.set_default_device('cuda:0')
This fixed the cpu/cuda error for me...
@arjunsbalaji do you have an update or more details? Otherwise, I would like to close this.
In general, I believe you have to set device='cuda:0', not just cuda.
No branches or pull requests
Hi,
When I specify device=cuda I get an error saying cpu and cuda devices are in use?
I can see that in generate.py .to(device) is being called in inputs and model so not sure why this is happening.
The text was updated successfully, but these errors were encountered: