You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Vercel Serverless doesn't inherently provide streaming capabilities. So when deploying to vercel the response does not stream in (like it does on local dev environment)
A clear and concise description of what you want and what your use case is.
For the same streaming capabilities I see on local dev to work when hosted on vercel.
Describe the solution you'd like
Vercel Solution
The above appears to be the explanation of how to make streaming work.. However I'm not able to implement this, As we are using this "useCompletion" hook here, so not sure how to modify code to get this to work.
The text was updated successfully, but these errors were encountered:
Feature request
Streaming implementation when hosted on vercel
Is your feature request related to a problem? Please describe.
Vercel Serverless doesn't inherently provide streaming capabilities. So when deploying to vercel the response does not stream in (like it does on local dev environment)
A clear and concise description of what you want and what your use case is.
For the same streaming capabilities I see on local dev to work when hosted on vercel.
Describe the solution you'd like
Vercel Solution
The above appears to be the explanation of how to make streaming work.. However I'm not able to implement this, As we are using this "useCompletion" hook here, so not sure how to modify code to get this to work.
The text was updated successfully, but these errors were encountered: