Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to enable custom CUDA kernel #310

Open
Firepal opened this issue Mar 14, 2024 · 3 comments
Open

Failed to enable custom CUDA kernel #310

Firepal opened this issue Mar 14, 2024 · 3 comments

Comments

@Firepal
Copy link

Firepal commented Mar 14, 2024

after running "install-py-dep.bat" and trying to run GPU-4G-3B-World

"Failed to switch model - Failed to enable custom CUDA kernel, ninja is required to load C++ extensions. You may be using the CPU version of PyTorch, please reinstall PyTorch with CUDA. Or if you are using a custom Python interpreter, you must compile the CUDA kernel by yourself or disable Custom CUDA kernel acceleration"

@kgolin
Copy link

kgolin commented Mar 16, 2024

you need to confirm that CUDA and pytorch are installed on your computer

@Firepal
Copy link
Author

Firepal commented Mar 16, 2024

@kgolin ??? the script does get cu117, and i have cuda toolkit

@josStorer
Copy link
Owner

Are you using Python 3.10? The precompiled kernel in the software is only available in Python 3.10.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants