Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to build PyTorch extension on Amazon Linux 2 #405

Open
informatter opened this issue Jan 15, 2024 · 1 comment
Open

Failed to build PyTorch extension on Amazon Linux 2 #405

informatter opened this issue Jan 15, 2024 · 1 comment

Comments

@informatter
Copy link

informatter commented Jan 15, 2024 •
edited

Hi guys,

I am trying to build the Pytorch extension on an Amazon Linux 2. Below are my current env details:

Conda version: 23.11.0
Python version: 3.11.5
torch version:  2.1.2+cu118          
torchvision version:  0.16.2+cu118 
CUDA version 11.8
GPU: Tesla T4
Driver Version: 470.182.03

Before running the below command I made sure to add my CUDA env variables to the .bashrc file:

export PATH=/usr/local/cuda-11.8/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda-11.8/targets/x86_64-linux/lib:$LD_LIBRARY_PATH

pip install -v git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch

I get the following log ( + errors):

  Cloning https://github.com/NVlabs/tiny-cuda-nn/ to /tmp/pip-req-build-xifev91j
  Running command git version
  git version 2.40.1
  Running command git clone --filter=blob:none https://github.com/NVlabs/tiny-cuda-nn/ /tmp/pip-req-build-xifev91j
  Cloning into '/tmp/pip-req-build-xifev91j'...
  Running command git rev-parse HEAD
  c12645dfbac707ccd82907a209edff9b258f1e3d
  Resolved https://github.com/NVlabs/tiny-cuda-nn/ to commit c12645dfbac707ccd82907a209edff9b258f1e3d
  Running command git submodule update --init --recursive -q
  Running command git rev-parse HEAD
  c12645dfbac707ccd82907a209edff9b258f1e3d
  Running command python setup.py egg_info
  /tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import parse_version
  nvcc: NVIDIA (R) Cuda compiler driver
  Copyright (c) 2005-2022 NVIDIA Corporation
  Built on Wed_Sep_21_10:33:58_PDT_2022
  Cuda compilation tools, release 11.8, V11.8.89
  Build cuda_11.8.r11.8/compiler.31833905_0
  Building PyTorch extension for tiny-cuda-nn version 1.7
  Obtained compute capability 75 from PyTorch
  Detected CUDA version 11.8
  Targeting C++ standard 17
  running egg_info
  creating /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info
  writing /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
  writing manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: tinycudann
  Running command python setup.py bdist_wheel
  /tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import parse_version
  Building PyTorch extension for tiny-cuda-nn version 1.7
  Obtained compute capability 75 from PyTorch
  nvcc: NVIDIA (R) Cuda compiler driver
  Copyright (c) 2005-2022 NVIDIA Corporation
  Built on Wed_Sep_21_10:33:58_PDT_2022
  Cuda compilation tools, release 11.8, V11.8.89
  Build cuda_11.8.r11.8/compiler.31833905_0
  Detected CUDA version 11.8
  Targeting C++ standard 17
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-cpython-311
  creating build/lib.linux-x86_64-cpython-311/tinycudann
  copying tinycudann/__init__.py -> build/lib.linux-x86_64-cpython-311/tinycudann
  copying tinycudann/modules.py -> build/lib.linux-x86_64-cpython-311/tinycudann
  running egg_info
  creating tinycudann.egg-info
  writing tinycudann.egg-info/PKG-INFO
  writing dependency_links to tinycudann.egg-info/dependency_links.txt
  writing top-level names to tinycudann.egg-info/top_level.txt
  writing manifest file 'tinycudann.egg-info/SOURCES.txt'
  reading manifest file 'tinycudann.egg-info/SOURCES.txt'
  writing manifest file 'tinycudann.egg-info/SOURCES.txt'
  copying tinycudann/bindings.cpp -> build/lib.linux-x86_64-cpython-311/tinycudann
  running build_ext
  /home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py:424: UserWarning: There are no g++ version bounds defined for CUDA version 11.8
    warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
  building 'tinycudann_bindings._75_C' extension
  creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies
  creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt
  creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src
  creating /tmp/pip-req-build-xifev91j/bindings/torch/src
  creating /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311
  creating /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311/tinycudann
  Emitting ninja build file /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311/build.ninja...
  Compiling objects...
  Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
  [1/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cpp_api.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o
  /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cpp_api.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
                   from /tmp/pip-req-build-xifev91j/src/cpp_api.cu:30:
  /tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
       #include <filesystem>
                ^~~~~~~~~~~~
  compilation terminated.
  [2/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/encoding.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o
  /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/encoding.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/object.h:32,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/encoding.h:33,
                   from /tmp/pip-req-build-xifev91j/src/encoding.cu:30:
  /tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
       #include <filesystem>
                ^~~~~~~~~~~~
  compilation terminated.
  [3/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/common_host.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o
  /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/common_host.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
                   from /tmp/pip-req-build-xifev91j/src/common_host.cu:31:
  /tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
       #include <filesystem>
                ^~~~~~~~~~~~
  compilation terminated.
  [4/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o
  /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc  -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cuda_graph.h:32,
                   from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/networks/cutlass_mlp.h:34,
                   from /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu:31:
  /tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
       #include <filesystem>
                ^~~~~~~~~~~~
  compilation terminated.
  [5/10] c++ -MMD -MF /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/os.o.d -pthread -B /home/ec2-user/miniconda3/envs/nerfstudio/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/dependencies/fmt/src/os.cc -o /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/os.o -std=c++17 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  [6/10] c++ -MMD -MF /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/format.o.d -pthread -B /home/ec2-user/miniconda3/envs/nerfstudio/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/dependencies/fmt/src/format.cc -o /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/format.o -std=c++17 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2100, in _run_ninja_build
      subprocess.run(
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/subprocess.py", line 571, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-req-build-xifev91j/bindings/torch/setup.py", line 189, in <module>
      setup(
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/__init__.py", line 103, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
      self.run_command(cmd)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/wheel/bdist_wheel.py", line 364, in run
      self.run_command("build")
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 131, in run
      self.run_command(cmd_name)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
      super().run_command(command)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 88, in run
      _build_ext.run(self)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
      self.build_extensions()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 873, in build_extensions
      build_ext.build_extensions(self)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
      self._build_extensions_serial()
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
      self.build_extension(ext)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 249, in build_extension
      _build_ext.build_extension(self, ext)
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
      objects = self.compiler.compile(
                ^^^^^^^^^^^^^^^^^^^^^^
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 686, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2116, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /home/ec2-user/miniconda3/envs/nerfstudio/bin/python3 -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize
  
  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)
  
  __file__ = %r
  sys.argv[0] = __file__
  
  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"
  
  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'/tmp/pip-req-build-xifev91j/bindings/torch/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-k6sekdbd
  cwd: /tmp/pip-req-build-xifev91j/bindings/torch
  Building wheel for tinycudann (setup.py) ... error
  ERROR: Failed building wheel for tinycudann
  Running setup.py clean for tinycudann
  Running command python setup.py clean
  /tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import parse_version
  Building PyTorch extension for tiny-cuda-nn version 1.7
  Obtained compute capability 75 from PyTorch
  nvcc: NVIDIA (R) Cuda compiler driver
  Copyright (c) 2005-2022 NVIDIA Corporation
  Built on Wed_Sep_21_10:33:58_PDT_2022
  Cuda compilation tools, release 11.8, V11.8.89
  Build cuda_11.8.r11.8/compiler.31833905_0
  Detected CUDA version 11.8
  Targeting C++ standard 17
  running clean
  'build/lib.linux-x86_64-cpython-311' does not exist -- can't clean it
  'build/bdist.linux-x86_64' does not exist -- can't clean it
  'build/scripts-3.11' does not exist -- can't clean it
Failed to build tinycudann
ERROR: Could not build wheels for tinycudann, which is required to install pyproject.toml-based projects

From the logs is quite hard for me to see what could be the error. Is it perhaps my python version causing problems?

Any help would be great

Thanks
@Goulustis
Copy link

From chatgpt, it seems like you need C++17 standard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Goulustis @informatter