Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow to define Model Parameters #690

Open
slemeur opened this issue Mar 26, 2024 · 0 comments
Open

Allow to define Model Parameters #690

slemeur opened this issue Mar 26, 2024 · 0 comments
Milestone
1.2

Comments

@slemeur
Copy link
Contributor

slemeur commented Mar 26, 2024

I'd like to be able to define the model parameters - which are really configuring the way the model serving is happening

https://github.com/abetlen/llama-cpp-python/blob/08e910f7a7e3657cf210ab8633a6994e1bde7164/llama_cpp/llama.py#L57-L109

As a user, I would also like to be able to see those parameters on a dedicated tabs of the Model service's details
@slemeur slemeur added this to the 1.2 milestone Mar 26, 2024
@slemeur slemeur changed the title When creating a model serving, I'd like to be able to define Model Parameters When creating a model service, I'd like to be able to define Model Parameters Mar 26, 2024
@slemeur slemeur changed the title When creating a model service, I'd like to be able to define Model Parameters Allow to define Model Parameters Mar 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
1.2
Development

No branches or pull requests
1 participant
@slemeur