Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: served-model-name is unused #399

Open
mrseeker opened this issue Apr 10, 2024 · 1 comment
Open

[Bug]: served-model-name is unused #399

mrseeker opened this issue Apr 10, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@mrseeker
Copy link

mrseeker commented Apr 10, 2024 •
edited

Your current environment

Running latest docker container

馃悰 Describe the bug

When trying to run the docker container with config "--served-model-name", the model name is not being used at all; instead, the original model name is being used when asking endpoint /models.
@mrseeker mrseeker added the bug Something isn't working label Apr 10, 2024
@fullstackwebdev
Copy link

fullstackwebdev commented Apr 15, 2024 •
edited

... you can sneak extra params in -e "SOME=THING --served-model-name gpt5"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mrseeker @fullstackwebdev