Replies: 2 comments
-
To address the issue where your custom tools are recognized but not executed by the Mistral-7B-Instruct-v0.2 model within the ReActAgent framework, consider the following steps:
By following these steps, you should be able to diagnose why your custom tools are not being executed as expected and make the necessary adjustments for successful integration with the Mistral-7B-Instruct-v0.2 model. Sources
|
Beta Was this translation helpful? Give feedback.
-
Hi, I am encountering a similar issue and the provided answer has not been helpful. I've intentionally added a filter to Metadata to enforce having zero source_nodes. This is to check how the LLM behaves under these conditions. Here's my code:
My goal is to prevent any output based on the LLM's knowledge because I want to control the input (via filters) by the frontend and the subsequent output. Any ideas would be great |
Beta Was this translation helpful? Give feedback.
-
I am having a little bit of confusion when I am creating my custom tools using ReActAgent. The agent is not able to execute the tool function, instead its providing a response based on what the model knowledge.
This is my code:
Loading huggingface model:
This is a minimal viable tool which returns today's date:
Model response:
The response generated does not use any tool, but it is able to identify the tool but does not use it. As the result the date i.e. 25th of March, 2023 is based on the model's knowledge.
Also adding few more custom tools which I created but has similar issue.
Tool 2: Accuracy Tool
Observations:
The llm is able to execute simply tools like add or multiply[https://docs.llamaindex.ai/en/stable/examples/agent/react_agent/] but when it comes to tools which has imports it fails.
Questions:
Is it something to do with the prompt?
Is my model unable to perform function calling with react agents?
How do I make my llm use the custom tools and provide observation?
In tutorials which are using similar tools with OpenAIAgent are able to get proper results, so my not mistral?
Beta Was this translation helpful? Give feedback.
All reactions