New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improvements to Swift LLM app #388

Merged

schmidt-sebastian merged 1 commit into main from mrschmidt/async

May 12, 2024

Collaborator

schmidt-sebastian commented May 11, 2024 •

edited

This:

Updates the model to 1.1 GPU
Adds async inference
Uses Gemma control tokens
Updates the API to the new CocoaPods (where init can fail)
Changes the chat context window to just the last message


          Improvements to Swift LLM app

58d9638

schmidt-sebastian force-pushed the mrschmidt/async branch from c159705 to 58d9638 Compare

May 11, 2024 16:05

nutsiepully approved these changes

View reviewed changes

Collaborator

nutsiepully left a comment

LG, Thanks!

schmidt-sebastian merged commit a686aa4 into main

4 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment