[Installation]: Failed building editable for vllm #4913
Comments
|
Thanks very much for your help. 
By the way, I have tried "pip install . " to install in a new conda environment with python=3.9. It didn't work. Here is the error: `Building wheels for collected packages: vllm × Building wheel for vllm (pyproject.toml) did not run successfully. note: This error originates from a subprocess, and is likely not a problem with pip. |
|
I assumed an old GPU because of this section of your original log Seeing your system setup with CUDA 12.4 and RTX 3090/4090 now seems like something that should be easily supported. I'm not sure what is going wrong here, but given it seems the build process is finding CUDA 11.x binaries, I would carefully check your paths to see if you have multiple versions of CUDA installed and check the version of |
The cmake command somehow remembers the old build directory You have a dirty build, and need to clean up previous build before you build again. |
|
Really Really Thanks to you all !!!
and Then I ran I got a new error and it shows "nvcc fatal : Unsupported gpu architecture 'compute_89'". I am so sorry that I can't figure out what wrong with the version. T^T |
Your cuda environment is too complicated. It somehow finds the 11.5 version. |
|
@Fanb1ing I think this bug is related to this commit: [Kernel] Add w8a8 CUTLASS kernels It build success when I reset the main branch to previous commit [Misc] remove old comments I guess Cutlass may have some conflict with cuda version or gpu driver version, which needs more analysis. @youkaichao Do you have time to look at this issue? |
|
I don't know how cutlass kernel affects this. You need to clean up the environment until it can finds the right cuda. |
|
My test environment only have one cuda version. and |
|
Thank to all you help. |
@youkaichao I solved this issue by upgrading to CUDA version 12.4. Therefore, my guess seems correct: some of the new features in the main branch may not be compatible with CUDA 11.8. |
|
It looks like the arch is explicitly set to be compute_90a here 2060e93#diff-1e7de1ae2d059d21e1dd75d5812d5a34b0222cef273b7c3a2af62eb747f9d20aR206 . Here's the error message |
|
I had this issue as well trying to build on a GCP VM with L4 on cuda 11.8. I had to revert before the above mentioned commit to |
|
Yeah it probably doesn't make sense to try to compile that using 11.8 since it'll fail. Can that be fixed by conditioning on the cuda version? |
Your current environment
How you are installing vllm
'''
Building wheels for collected packages: vllm
Building editable for vllm (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building editable for vllm (pyproject.toml) did not run successfully.
│ exit code: 1
╰─
CMake Error at /tmp/pip-build-env-l6d1bzk0/overlay/lib/python3.11/site-packages/cmake/data/share/cmake-3.29/Modules/CMakeDetermineCompilerId.cmake:814 (message):
Compiling the CUDA compiler identification source file
"CMakeCUDACompilerId.cu" failed.
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building editable for vllm
Failed to build vllm
ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects
'''
The text was updated successfully, but these errors were encountered: