You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[TensorRT-LLM] TensorRT-LLM version: 0.10.0.dev2024050700
0.10.0.dev2024050700
Traceback (most recent call last):
File "/app/tensorrt-llm/examples/llama/../llama/convert_checkpoint.py", line 466, in <module>
main()
File "/app/tensorrt-llm/examples/llama/../llama/convert_checkpoint.py", line 445, in main
assert args.modelopt_quant_ckpt_path is not None
It looks the convert_checkpoint.py require a parameter for modelopt_quant_ckpt_path. How to generate modelopt_quant_ckpt_path?
The text was updated successfully, but these errors were encountered:
I use following code to generate the checkpoint:
get error:
It looks the convert_checkpoint.py require a parameter for modelopt_quant_ckpt_path. How to generate modelopt_quant_ckpt_path?
The text was updated successfully, but these errors were encountered: