You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi Team, We are exploring fingpt-forecaster_dow30_llama2-7b_lora as part of FINGPT. However we are unable to access the model using model card below is the code snippet and error. Do we need any elevated access Keys to access the model? Can anyone guide on how to try out the pretrained FINGPT LLM as is with sample data.
Code snippet:
from datasets import load_dataset
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
import torch
access_token = "xxxxxxxxxxxxxxx" # huggingface access token
base_model = AutoModelForCausalLM.from_pretrained(
'meta-llama/Llama-2-7b-chat-hf',
trust_remote_code=True,
device_map="auto",
torch_dtype=torch.float16, # optional if you have enough VRAM
token=access_token,
)
tokenizer = AutoTokenizer.from_pretrained('meta-llama/Llama-2-7b-chat-hf',token=access_token,)
model = PeftModel.from_pretrained(base_model, 'FinGPT/fingpt-forecaster_dow30_llama2-7b_lora')
model = model.eval()
Error messages:
Cannot access gated repo for url https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/resolve/main/config.json.
Access to model meta-llama/Llama-2-7b-chat-hf is restricted and you are not in the authorized list. Visit https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to ask for access.
OSError: You are trying to access a gated repo.
Make sure to request access at https://huggingface.co/meta-llama/Llama-2-7b-chat-hf and pass a token having permission to this repo either by logging in with huggingface-cli login or by passing token=<your_token>.
Token Generation -
The text was updated successfully, but these errors were encountered:
Hi Team, We are exploring fingpt-forecaster_dow30_llama2-7b_lora as part of FINGPT. However we are unable to access the model using model card below is the code snippet and error. Do we need any elevated access Keys to access the model? Can anyone guide on how to try out the pretrained FINGPT LLM as is with sample data.
Code snippet:
Error messages:
Token Generation -
The text was updated successfully, but these errors were encountered: