Claude to ChatGPT does not stream

[johnd0e]

Testing http://127.0.0.1:8000/v1/chat/completions/Claude

With "stream": false it works.

With "stream": true it outputs: Error : __enter__

P.S.
http://127.0.0.1:8000/v1/chat/completions is also ok

[zexry619]

Has this been fixed for now bro @Amm1rr ?

Because it seems interesting that it can be used in various GUIs for openai

[Amm1rr]

Of course @zexry619

It is available and working right now.

Streaming response is not ready yet for Claude, but without streaming it is working nicely.

Do you have problems with streaming response with ChatGPT or Bard?

Just pull request again, because of the issue you had with Claude's session, I updated the codes for Claude's endpoints.

Affected endpoints:

• /claude
• /claude/v1/chat/completions

I'm into using Claude instead of ChatGPT in some projects like Auto Code Review.

[zexry619]

I've done a git pull.
But there is still no change here.
Did I make mistake?

[Amm1rr]

Which Claude endpoints did you check?

• /claude
• /claude/v1/chat/completions

[zexry619]

This :

/claude/v1/chat/completions

[Amm1rr]

Is there also problem with /claude?

[zexry619]

No, that's fine, /claude/v1/chat/completions is also fine if the stream is set to false.

[Amm1rr]

Bro, you gave me a shock at first : ) nice

Can you please try ChatGPT or Bard with True stream?

[zexry619]

I'm not planning on using anything else just want to use claude, however if you're planning on making an imitation openai endpoint for bard I might be more interested :)

[Amm1rr]

I get it. I like this model too.

I want to use Bard and Claude rather than ChatGPT and link it to OpenAI. But first, I need to make sure it's stable.

Streaming for fast responses matters too.

Streaming is an issue for some users with all AI models, unfortunately not for myself.

By the way, I'll improve this over time.

Thanks!

[zexry619]

Nice!. I'll be waiting for an update for this stream issue!.

[zexry619]

You can try looking at this repository: https://github.com/oldweipro/claude-to-chatgpt

For stream claude there is no problem.
I hope you can develop it for google bard. @Amm1rr

[Amm1rr]

I changed the streaming function for Claude and pushed a new branch called stream.

Unfortunately, in recent days I have not been able to run the python scripts to see the results.

Please clone and test this new branch and check with Claude to let me know how it is performing.

[johnd0e]

• /claude: no difference
• /claude/v1/chat/completions: Error : request() got an unexpected keyword argument 'stream'

[Amm1rr]

This was my final attempt to prevent having to make changes to the classes. :)

However, it seems that making revisions is the only option.