Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No such file or directory #105

Open
Alpslee opened this issue May 6, 2024 · 0 comments
Open

No such file or directory #105

Alpslee opened this issue May 6, 2024 · 0 comments

Comments

@Alpslee
Copy link

Alpslee commented May 6, 2024

I run it on macbook m2 air, when run:
python tools/download_model.py --model VILA_7B_awq_int4_CLIP_ViT-L --QM QM_ARM

I got this:
Start downloading the model to ./LLaMA2_7B_chat_awq_int4.zip.
172KB [00:00, 267.55KB/s]

File downloaded successfully: ./LLaMA2_7B_chat_awq_int4.zip
The md5sum of the file does not match the expected md5sum. Expected: af20c96de302c503a9fcfd5877ed0600, got: fd4917f2c0669b14a56d5be6a370bc75

then run:
make chat -j
./chat
TinyChatEngine by MIT HAN Lab: https://github.com/mit-han-lab/TinyChatEngine
Using model: LLaMA2_7B_chat
Using AWQ for 4bit quantization: https://github.com/mit-han-lab/llm-awq
Loading model... No such file or directory: INT4/models/LLaMA_7B_2_chat/decoder/embed_tokens/weight.bin
libc++abi: terminating due to uncaught exception of type char const*
zsh: abort ./chat

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant