Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

馃悰 [Bug] Nightly import fails #2820

Open
laikhtewari opened this issue May 7, 2024 · 2 comments
Open

馃悰 [Bug] Nightly import fails #2820

laikhtewari opened this issue May 7, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@laikhtewari
Copy link
Collaborator

Bug Description

Installed nightly and got OSError: libnvinfer_plugin.so.10: cannot open shared object file: No such file or directory

To Reproduce

pip install -U --pre torch_tensorrt --index-url https://download.pytorch.org/whl/nightly/cu121
python3 -c "import torch_tensorrt"

Error:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch_tensorrt/__init__.py", line 102, in <module>
    _register_with_torch()
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch_tensorrt/__init__.py", line 96, in _register_with_torch
    torch.ops.load_library(trtorch_dir + "/lib/libtorchtrt.so")
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/site-packages/torch/_ops.py", line 1242, in load_library
    ctypes.CDLL(path)
  File "/home/ltewari/scratch/miniconda3/envs/nightly/lib/python3.9/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libnvinfer_plugin.so.10: cannot open shared object file: No such file or directory

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

  • Torch-TensorRT Version (e.g. 1.0.0): torch-tensorrt==2.4.0.dev20240429+cu121
  • PyTorch Version (e.g. 1.0): torch==2.4.0.dev20240507+cu121
  • CPU Architecture: x86_64
  • OS (e.g., Linux): Ubuntu
  • How you installed PyTorch (conda, pip, libtorch, source): pip (nightly)
  • Build command you used (if compiling from source): NA
  • Are you using local sources or building from archives: NA
  • Python version: Python 3.9.18
  • CUDA version: 12.4
  • GPU models and configuration: H100 PCIe
  • Any other relevant information:
@laikhtewari laikhtewari added the bug Something isn't working label May 7, 2024
@narendasan
Copy link
Collaborator

@laikhtewari do you have tensorrt installed?

@laikhtewari
Copy link
Collaborator Author

laikhtewari commented May 7, 2024

Looks like it, I have tensorrt==8.6.1.post1
Shouldn't that be installed automatically as a dependency when I pip install torch_tensorrt?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants