You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bug description
Getting Error while doing chatClient.stream(prompt).
This only happens for chatClient.stream(prompt). My finding is it happens due to WebClient
CURL and chatClient.call(prompt) work fine.
Caused by: java.net.UnknownHostException: Failed to resolve 'api.openai.com' [A(1)]
Caused by: io.netty.resolver.dns.DnsNameResolverTimeoutException: [19766: /192.168.29.1:53] DefaultDnsQuestion(api.openai.com. IN A) query '19766' via UDP timed out after 5000 milliseconds (no stack trace available)
Environment
Please provide as many details as possible: Spring AI version - 0.8.1,
Java version - 17,
vector store - SimpleVectorStore (InMemory)
Steps to reproduce
call below method for any prompt.
Prompt prompt = new Prompt("tell me something about java");
return this.chatClient.stream(prompt).map((ChatResponse chatResponse) -> {
if (!isValidResponse(chatResponse)) {
logger.warn("ChatResponse or the result output is null!");
return "";
}
AssistantMessage assistantMessage = chatResponse.getResult().getOutput();
this.chatHistory.addMessage(chatId, assistantMessage);
return (assistantMessage.getContent() != null) ? assistantMessage.getContent() : "";
});
Expected behavior
Code should stream proper llm response
Minimal Complete Reproducible example
Prompt prompt = new Prompt("tell me something about java");
return this.chatClient.stream(prompt).map((ChatResponse chatResponse) -> {
if (!isValidResponse(chatResponse)) {
logger.warn("ChatResponse or the result output is null!");
return "";
}
AssistantMessage assistantMessage = chatResponse.getResult().getOutput();
this.chatHistory.addMessage(chatId, assistantMessage);
return (assistantMessage.getContent() != null) ? assistantMessage.getContent() : "";
});
The text was updated successfully, but these errors were encountered:
@deepakn27 I believe that you want to customize WebClient to make it to connect to an HTTP proxy (instead of resolving the IP address of api.openai.com and connect directly to that IP address)? Maybe you should update this issue to make it clear that you need WebClient to be customizable. That will be helpful for closing it.
deepakn27
changed the title
Getting error on return this.chatClient.stream(prompt)
Support for customization of webclient for OpenAI
May 5, 2024
Bug description
Getting Error while doing chatClient.stream(prompt).
This only happens for chatClient.stream(prompt). My finding is it happens due to WebClient
CURL and chatClient.call(prompt) work fine.
Caused by: java.net.UnknownHostException: Failed to resolve 'api.openai.com' [A(1)]
Caused by: io.netty.resolver.dns.DnsNameResolverTimeoutException: [19766: /192.168.29.1:53] DefaultDnsQuestion(api.openai.com. IN A) query '19766' via UDP timed out after 5000 milliseconds (no stack trace available)
Environment
Please provide as many details as possible: Spring AI version - 0.8.1,
Java version - 17,
vector store - SimpleVectorStore (InMemory)
Steps to reproduce
call below method for any prompt.
Prompt prompt = new Prompt("tell me something about java");
return this.chatClient.stream(prompt).map((ChatResponse chatResponse) -> {
Expected behavior
Code should stream proper llm response
Minimal Complete Reproducible example
Prompt prompt = new Prompt("tell me something about java");
return this.chatClient.stream(prompt).map((ChatResponse chatResponse) -> {
The text was updated successfully, but these errors were encountered: