-
-
Notifications
You must be signed in to change notification settings - Fork 13.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Question] Differences among Conversational Retrieval QA to Conversational Retrieval Agent #2395
Comments
I see two issues:
FLow 1Flow 2 (rare default message - considering this node can be used for gemini, mistral, and others)-- Let's ask to @HenryHengZJ if it's a misconfiguration or just a limitation. |
@toi500 thanks for your reply
I believe that's a major bug on the conventional agent @HenryHengZJ let me know if we miss anything and if there's any workaround to resolve this, or in general if there's any other way we can use the conversational retrieval QA along with custom tool. Thanks |
any luck with Tool Agent? |
Tried it as well same behavior |
It looks like that the |
@toi500 @HenryHengZJ any news? It's blocking us |
I don't believe it's possible to achieve the same level of comprehensive response from the Agent using the Retrieve Tool, as you're attempting in flow 2. What the Agent is doing there is executing a vector similarity search in Pinecone without the proper context. The only way to obtain similar results as the flow 1 is to instruct the Agent to utilize the whole chain as a tool, and this, if I am not getting this wrong, can only be achieved via the Chain Tool, bugged at the moment. |
How about adding a HyDe Retriever? It doesn't yield the same results but you could apply a prompt on the documents returned. Otherwise very interesting detail shared here I was also not happy with the retriever tool only. |
fixed this issue via PR @toi500 @sirsimonson FYI |
@toi500 unfortunately no, I'm still waiting for @HenryHengZJ to review that. Either way I'm using it and it works perfect! |
Describe the bug
I'm having a chatflow based on Conversational Retrieval QA, OpenAI and Pinecone as vector store. The flows works smoothly as I expect. Later on, I wanted to add a custom tool to that flow so I needed to convert it to a chatflow based on Conversational Retrieval Agent (See screenshots below) and Retrieval Tool. When hitting the same question, the results were totally different conceptually.
I want to emphasize that the OpenAI temperature and all other parameters were the same in both flows
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The same results (conceptually) should be the same on both flows.
Screenshots
chat flow 1 (good)
VS.
chat flow 2 (not good)
Let me know what I miss and how to fix it. By the end of the road all I want is chatflow1 + tool.
@HenryHengZJ please help
Thanks
The text was updated successfully, but these errors were encountered: