Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

337 Open 1,243 Closed
337 Open 1,243 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Make torchserve-kfs docker image multiplatform
#3161 opened May 25, 2024 by DanielTemesgen
1
Support "model-control-mode" in configuration enhancement New feature or request p0 high priority security
#3158 opened May 23, 2024 by lxning v0.12.0
@udaij12
Enable token authentication as default enhancement New feature or request p0 high priority security
#3157 opened May 23, 2024 by lxning v0.12.0
@udaij12
install dependency via conda enhancement New feature or request p0 high priority
#3156 opened May 22, 2024 by lxning v0.12.0
@namannandan
model archiver example very long 1 liner
#3154 opened May 22, 2024 by GeeCastro
1
Limit resource in docker compose and worker in model triaged Issue has been reviewed and triaged
#3150 opened May 21, 2024 by ToanLyHoa
@agunapal
2
Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12
@mreso @lxning
question to model inference optimization triaged Issue has been reviewed and triaged
#3134 opened May 4, 2024 by geraldstanje
@agunapal
1
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120 opened Apr 29, 2024 by pengxin233
1
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner
5
Load model failed - error: Worker died
#3104 opened Apr 23, 2024 by geraldstanje
6
Update large_models/gpt_fast to llama3
#3102 opened Apr 22, 2024 by mreso
@mreso
Update large_models/tp_llama to llama3
#3101 opened Apr 22, 2024 by mreso
@mreso
Update large_models/inferentia2/llama2 to Llama3
#3100 opened Apr 22, 2024 by mreso
@lxning
Update LLM/llama2 to Llama3
#3099 opened Apr 22, 2024 by mreso
@mreso
Update cpp/llamacpp to Llama 3
#3098 opened Apr 22, 2024 by mreso
@mreso
1
Metrics collector crashes when NVIDIA MIGs are present
#3090 opened Apr 16, 2024 by UrkoAT
1
TorchServe crashes in production with `WorkerThread - IllegalStateException error'
#3087 opened Apr 15, 2024 by MaelitoP
4
Serve multiple models with both CPU and GPU question Further information is requested triaged Issue has been reviewed and triaged
#3078 opened Apr 10, 2024 by hungtrieu07
3
TorchServe linux aarch64 plan dependencies Pull requests that update a dependency file enhancement New feature or request
#3072 opened Apr 3, 2024 by agunapal
4 tasks
@agunapal
Torchserve error for more than 14 python async requests on workflow
#3069 opened Apr 3, 2024 by bennykins
2
[RFC]: Deprecation notice for TorchText installation in TorchServe deprecation
#3066 opened Apr 2, 2024 by agunapal
v0.10.0 OpenAPI specification does not validate OIP
#3058 opened Mar 30, 2024 by ericphanson
CPU Launcher fails available check with venv
#3049 opened Mar 27, 2024 by ElfoLiNk
3
\ready API for Kubernetes probe to know when TorchServe backend is ready to receive traffic kubernetes
#3047 opened Mar 27, 2024 by agunapal
1
ProTip! Find all open issues with in progress development work with linked:pr.