You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thank you for your great work!
I'm trying to run tensorrt-llm on my windows pc. When I try to quantize the llma2 model to int8, I meet an error about nvidia-ammo. I try to install this by "pip download --extra-index-url https://pypi.nvidia.com nvidia-ammo", I meet the error of "RuntimeError: Didn't find wheel for nvidia-ammo 0.9.4". After I check the versions provided by https://pypi.nvidia.com/nvidia-ammo/, it seems that there isn't a version for windows.
So, I wonder how can I install nvidia-ammo on my computer.
Thank you.
The text was updated successfully, but these errors were encountered:
Thank you for your great work!
I'm trying to run tensorrt-llm on my windows pc. When I try to quantize the llma2 model to int8, I meet an error about nvidia-ammo. I try to install this by "pip download --extra-index-url https://pypi.nvidia.com nvidia-ammo", I meet the error of "RuntimeError: Didn't find wheel for nvidia-ammo 0.9.4". After I check the versions provided by https://pypi.nvidia.com/nvidia-ammo/, it seems that there isn't a version for windows.
So, I wonder how can I install nvidia-ammo on my computer.
Thank you.
The text was updated successfully, but these errors were encountered: