Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to use "python setup.py install" to install spatial-correlation-sampler #98

Open
JxinYUN opened this issue Sep 5, 2023 · 4 comments

Comments

@JxinYUN
Copy link

JxinYUN commented Sep 5, 2023

I had cloned “https://github.com/ClementPinard/Pytorch-Correlation-extension” and used the commend: python setup.py install, but there are something worth.
I don't know how to tackle that. Help me please.

cuda version: 11.2
pytorch version: 2.0.1
python version: 3.11.4
ubuntu version: 20.04

The follow is the error statement:
No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda-11.0'
running install
/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

    ********************************************************************************
    Please avoid running ``setup.py`` directly.
    Instead, use pypa/build, pypa/installer or other
    standards-based tools.

    See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
    ********************************************************************************

!!
self.initialize_options()
/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

    ********************************************************************************
    Please avoid running ``setup.py`` and ``easy_install``.
    Instead, use pypa/build, pypa/installer or other
    standards-based tools.

    See https://github.com/pypa/setuptools/issues/917 for details.
    ********************************************************************************

!!
self.initialize_options()
running bdist_egg
running egg_info
writing Correlation_Module/spatial_correlation_sampler.egg-info/PKG-INFO
writing dependency_links to Correlation_Module/spatial_correlation_sampler.egg-info/dependency_links.txt
writing requirements to Correlation_Module/spatial_correlation_sampler.egg-info/requires.txt
writing top-level names to Correlation_Module/spatial_correlation_sampler.egg-info/top_level.txt
reading manifest file 'Correlation_Module/spatial_correlation_sampler.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'Correlation_Module/spatial_correlation_sampler.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
Traceback (most recent call last):
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/Pytorch-Correlation-extension-master/Pytorch-Correlation-extension-master/setup.py", line 69, in
launch_setup()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/Pytorch-Correlation-extension-master/Pytorch-Correlation-extension-master/setup.py", line 37, in launch_setup
setup(
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/init.py", line 107, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/install.py", line 80, in run
self.do_egg_install()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/install.py", line 129, in do_egg_install
self.run_command('bdist_egg')
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/bdist_egg.py", line 164, in run
cmd = self.call_command('install_lib', warn_dir=0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/bdist_egg.py", line 150, in call_command
self.run_command(cmdname)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
self.build_extensions()
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 383, in _check_cuda_version
torch_cuda_version = packaging.version.parse(torch.version.cuda)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/pkg_resources/_vendor/packaging/version.py", line 52, in parse
return Version(version)
^^^^^^^^^^^^^^^^
File "/home/xiaojianxin/anaconda3/envs/depth_warehouse_estimation/lib/python3.11/site-packages/pkg_resources/_vendor/packaging/version.py", line 196, in init
match = self._regex.search(version)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: expected string or bytes-like object, got 'NoneType'

@ClementPinard
Copy link
Owner

cuda version: 11.2

No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda-11.0'

Looks like your problem is that the compiler points to the wrong cuda version.

Have you set the environment variable ENV and LD_LIBRARY_PATH ?

https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#environment-setup

@JxinYUN
Copy link
Author

JxinYUN commented Sep 5, 2023

cuda version: 11.2

No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda-11.0'

Looks like your problem is that the compiler points to the wrong cuda version.

Have you set the environment variable ENV and LD_LIBRARY_PATH ?

https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#environment-setup

Yes, the reason is the incompatible version of CUDA.
I use "match = self._regex.search(str(version))" to replace "match = self._regex.search(version)" and then reinstall my torch that version is compatible with my CUDA.
Finally, I install spatial-correlation-sampler successfully!
Thanks.

@Wei-Wu233
Copy link

cuda version: 11.2

No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda-11.0'

Looks like your problem is that the compiler points to the wrong cuda version.
Have you set the environment variable ENV and LD_LIBRARY_PATH ?
https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#environment-setup

Yes, the reason is the incompatible version of CUDA. I use "match = self._regex.search(str(version))" to replace "match = self._regex.search(version)" and then reinstall my torch that version is compatible with my CUDA. Finally, I install spatial-correlation-sampler successfully! Thanks.

I also encountered this problem, the main reason is that the version of cuda and torch do not match, but after I changed the version of torch, I still have the following problem:
(fsam) E:\code\Pytorch-Correlation-extension-master>pip install spatial-correlation-sampler
Collecting spatial-correlation-sampler
Using cached spatial_correlation_sampler-0.4.0.tar.gz (9.3 kB)
Preparing metadata (setup.py) ... done
Requirement already satisfied: torch>=1.1 in d:\programdata\anaconda\envs\fsam\lib\site-packages (from spatial-correlation-sampler) (1.12.1+cu113)
Requirement already satisfied: numpy in d:\programdata\anaconda\envs\fsam\lib\site-packages (from spatial-correlation-sampler) (1.26.1)
Requirement already satisfied: typing-extensions in d:\programdata\anaconda\envs\fsam\lib\site-packages (from torch>=1.1->spatial-correlation-sampler) (4.8.0)
Building wheels for collected packages: spatial-correlation-sampler
Building wheel for spatial-correlation-sampler (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [22 lines of output]
running bdist_wheel
D:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\utils\cpp_extension.py:411: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
warnings.warn(msg.format('we could not find ninja.'))
running build
running build_py
creating build
creating build\lib.win-amd64-cpython-39
creating build\lib.win-amd64-cpython-39\spatial_correlation_sampler
copying Correlation_Module\spatial_correlation_sampler\spatial_correlation_sampler.py -> build\lib.win-amd64-cpython-39\spatial_correlation_sampler
copying Correlation_Module\spatial_correlation_sampler_init_.py -> build\lib.win-amd64-cpython-39\spatial_correlation_sampler
running build_ext
D:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\utils\cpp_extension.py:346: UserWarning: Error checking compiler version for cl: [WinError 2] 系统找不到指定的文件。
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
building 'spatial_correlation_sampler_backend' extension
creating build\temp.win-amd64-cpython-39
creating build\temp.win-amd64-cpython-39\Release
creating build\temp.win-amd64-cpython-39\Release\Correlation_Module
"D:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -DUSE_CUDA -ID:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\include -ID:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\include\torch\csrc\api\include -ID:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\include\TH -ID:\ProgramData\anaconda\envs\fsam\lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.3\include" -ID:\ProgramData\anaconda\envs\fsam\include -ID:\ProgramData\anaconda\envs\fsam\Include "-ID:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\ATLMFC\include" "-ID:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include" /EHsc /TpCorrelation_Module\correlation.cpp /Fobuild\temp.win-amd64-cpython-39\Release\Correlation_Module\correlation.obj /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /EHsc -fopenmp -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=spatial_correlation_sampler_backend -D_GLIBCXX_USE_CXX11_ABI=0
cl: 命令行 warning D9002 :忽略未知选项“-fopenmp”
correlation.cpp
D:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include\cstddef(12): fatal error C1083: 无法打开包括文件: “stddef.h”: No such file or directory
error: command 'D:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\HostX86\x64\cl.exe' failed with exit code 2
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for spatial-correlation-sampler
Running setup.py clean for spatial-correlation-sampler
Failed to build spatial-correlation-sampler
ERROR: Could not build wheels for spatial-correlation-sampler, which is required to install pyproject.toml-based projects

@ClementPinard
Copy link
Owner

D:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include\cstddef(12): fatal error C1083: 无法打开包括文件: “stddef.h”: No such file or directory

Looks like a microsoft + visual code specific error where it cannot file some standard header file. Is your problem fixed now ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants