-
Notifications
You must be signed in to change notification settings - Fork 344
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Api Server Example #414
Comments
I might have a more elaborate project utilizing rustformers/llm for a server that could be open sourced. Let me know if there is interest. It exposes WebSocket/SSE interfaces as well as endpoints for embedding, configurable sets of prompts and more. |
Would love to see it and contribute! |
It took a bit longer than expected, but here it is: https://github.com/pixelspark/poly 🎉 let me know what you think @e253 |
@philpax you might like it too |
That's awesome! Sorry, I was very behind on my emails. I've added it to the README - shame I couldn't mention it at the talk. |
I made an example rocket.rs api server https://github.com/aurelianai/aurelian_server if anyone is interested.
The text was updated successfully, but these errors were encountered: