Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAG seems lazy and don't understand the sample #7

Open
thhung opened this issue Mar 8, 2024 · 1 comment
Open

RAG seems lazy and don't understand the sample #7

thhung opened this issue Mar 8, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@thhung
Copy link

thhung commented Mar 8, 2024

Hello, I used the demo notebook you provided with some questions. Most of the time the model cannot answer the questions that we can find the answers from the sample's text. Could you provide some guidance to overcome this issue?

Example:

Question: "How did her life became hard?" 
Answer:  Sure, here's the answer to your question: The passage does not provide any information about how her life became hard, so I cannot answer this question from the context.

Maybe something wrong with the context? The code is exactly the same as your demo, except the few code added to install dependencies and correct typos.

@parthsarthi03
Copy link
Owner

I'm not able to reproduce this: in the demo when I pass in your question, I get the following answer with the default settings.

Question:  How did her life became hard?
Answer:  Her life became hard after her mother passed away and her father remarried a woman with two cruel daughters. The stepmother and stepsisters mistreated Cinderella, making her do all the household chores and mocking her appearance. She was forced to sleep by the hearth among the cinders, given menial tasks, and subjected to ridicule and sabotage by her stepsisters. Despite her pious and good nature, Cinderella faced constant hardship and cruelty from her new family, leading to a difficult and challenging life.

Are you using a custom model for QA/Summarization or the default?
What are the extra dependencies/typos?

@parthsarthi03 parthsarthi03 added invalid This doesn't seem right bug Something isn't working and removed invalid This doesn't seem right labels Mar 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants