Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem using the factscorer function with LLaMa #36

Open
samuel-LP opened this issue Jan 14, 2024 · 1 comment
Open

problem using the factscorer function with LLaMa #36

samuel-LP opened this issue Jan 14, 2024 · 1 comment

Comments

@samuel-LP
Copy link

Good morning,

I was trying to use the factscorer function.

With this code :
Screenshot 2024-01-14 at 15 55 19

I received this message error :
Screenshot 2024-01-14 at 15 58 43

If I remove the openai_key=None in factscore = FactScorer(model_name="retrieval+llama", data_dir="/kaggle/working/"), I have this error :
AssertionError: Please place your OpenAI APT Key in api.key.

I would like to know if I need to have an OpenAI key for using FactScore even if my model is LLaMa as you can see on the first picture.

Thank you!

@samuel-LP samuel-LP changed the title problem to use the factscorer with LLaMa problem to use the factscorer function with LLaMa Jan 14, 2024
@samuel-LP samuel-LP changed the title problem to use the factscorer function with LLaMa problem using the factscorer function with LLaMa Jan 14, 2024
@martiansideofthemoon
Copy link
Collaborator

Hi @samuel-LP, the OpenAI key is needed for the atomic fact generation step (which uses davinci-003 in both workflows).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants