Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Persist user interaction to disk so that it can be continued #4

Open
amakropoulos opened this issue Jan 9, 2024 · 1 comment
Open
Labels
enhancement New feature or request
Milestone

Comments

@amakropoulos
Copy link
Collaborator

llama.cpp allows to store the conversation along with the processed tokens to disk so that the interaction can be resumed at the next run.
Purpose of this feature is to enable this functionality in LLMUnity.

@amakropoulos amakropoulos added the enhancement New feature or request label Jan 9, 2024
@amakropoulos amakropoulos added this to the v1.1.0 milestone Jan 11, 2024
@amakropoulos amakropoulos modified the milestones: v1.1.0, v1.2.0 Feb 9, 2024
@amakropoulos
Copy link
Collaborator Author

This is blocked at the moment as the llama.cpp server doesn't expose this functionality

@amakropoulos amakropoulos added this to the v1.3.0 milestone Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: In Progress
Development

No branches or pull requests

1 participant