We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
latest tgi docker image (I think 2.0) ubuntu 20
Start tgi using docker compose using command. eg command: --model-id TechxGenus/starcoder2-3b-GPTQ --quantize gptq --port 3000 the logs look like this
command: --model-id TechxGenus/starcoder2-3b-GPTQ --quantize gptq --port 3000
Remove command option and move all the args to enviroment. eg
enviroment
environment: - PORT=3000 - MODEL_ID=TechxGenus/starcoder2-3b-GPTQ - QUANTIZE=gptq
Logs loose formatting
Logs should retain formatting.
Not really the biggest issue 🤗
The text was updated successfully, but these errors were encountered:
No branches or pull requests
System Info
latest tgi docker image (I think 2.0)
ubuntu 20
Information
Tasks
Reproduction
Start tgi using docker compose using command. eg
command: --model-id TechxGenus/starcoder2-3b-GPTQ --quantize gptq --port 3000
the logs look like this
Remove command option and move all the args to
enviroment
. egLogs loose formatting
Expected behavior
Logs should retain formatting.
Not really the biggest issue 🤗
The text was updated successfully, but these errors were encountered: