Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OSError: Can't load tokenizer for 'meta-llama/Llama-2-7b-chat-hf'. #22

Open
wuyiqii opened this issue May 10, 2024 · 0 comments
Open

OSError: Can't load tokenizer for 'meta-llama/Llama-2-7b-chat-hf'. #22

wuyiqii opened this issue May 10, 2024 · 0 comments

Comments

@wuyiqii
Copy link

wuyiqii commented May 10, 2024

Thank you for your wonderful work, but I had some issues running python minigpt4_video_inference.py on ubuntu system: Loading LLAMA
Traceback (most recent call last):
File "/share/data02/wuyiqidata/MiniGPT4-video/minigpt4_video_inference.py", line 165, in
model, vis_processor = init_model(args)
File "/share/data02/wuyiqidata/MiniGPT4-video/minigpt4/common/eval_utils.py", line 63, in init_model
model = model_cls.from_config(model_config).to('cuda:0')
File "/share/data02/wuyiqidata/MiniGPT4-video/minigpt4/models/mini_gpt4_llama_v2.py", line 765, in from_config
model = cls(
File "/share/data02/wuyiqidata/MiniGPT4-video/minigpt4/models/mini_gpt4_llama_v2.py", line 125, in init
self.llama_tokenizer = LlamaTokenizer.from_pretrained(llama_model,use_fast=False) #
File "/share/data02/wuyiqidata/Anaconda3/envs/minigpt4_video/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 2013, in from_pretrained
raise EnvironmentError(
OSError: Can't load tokenizer for 'meta-llama/Llama-2-7b-chat-hf'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'meta-llama/Llama-2-7b-chat-hf' is the correct path to a directory containing all relevant files for a LlamaTokenizer tokenizer.
how can I fix it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant