Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

347 Open 1,244 Closed
347 Open 1,244 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Follow up on token authentication PR comments
#3185 opened Jun 7, 2024 by mreso v0.12.0
@udaij12
[RFC] Token Authorization by default
#3184 opened Jun 7, 2024 by udaij12
"Token Authorization" for gRPC
#3181 opened Jun 6, 2024 by udaij12
"Model mode control" for gRPC
#3180 opened Jun 6, 2024 by udaij12
ImportError: cannot import name 'packaging' from 'pkg_resources'
#3176 opened Jun 5, 2024 by Sieltek
Enable pytest test_torch_compile.py: test_serve_inference pytest
#3174 opened Jun 3, 2024 by agunapal v0.12.0
@agunapal
Enable pytest test_example_torch_compile.py:test_example_torch_compile.py pytest
#3173 opened Jun 3, 2024 by agunapal v0.12.0
@agunapal
Two-way authentication/Mutual SSL in gRPC enhancement New feature or request
#3172 opened Jun 3, 2024 by MohamedAliRashad
The service crashes if the model takes a long time to respond grpc
#3168 opened May 31, 2024 by yurkoff-mv
NotImplementedError: Cannot copy out of meta tensor; no data! + Models not generating output text
#3167 opened May 31, 2024 by bjorquera1
Standardize PyTorch 2.x features config in model-config.yaml enhancement New feature or request
#3164 opened May 29, 2024 by agunapal v0.12.0
Make torchserve-kfs docker image multiplatform enhancement New feature or request kfserving
#3161 opened May 25, 2024 by DanielTemesgen
1
Support "model-control-mode" in configuration enhancement New feature or request p0 high priority security
#3158 opened May 23, 2024 by lxning v0.12.0
@udaij12
Enable token authentication as default enhancement New feature or request p0 high priority security
#3157 opened May 23, 2024 by lxning v0.12.0
@udaij12
install dependency via conda enhancement New feature or request p0 high priority
#3156 opened May 22, 2024 by lxning v0.12.0
@namannandan
model archiver example very long 1 liner
#3154 opened May 22, 2024 by GeeCastro
1
Limit resource in docker compose and worker in model triaged Issue has been reviewed and triaged
#3150 opened May 21, 2024 by ToanLyHoa
@agunapal
2
Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12
@mreso @lxning
question to model inference optimization triaged Issue has been reviewed and triaged
#3134 opened May 4, 2024 by geraldstanje
@agunapal
1
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120 opened Apr 29, 2024 by pengxin233
1
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner
5
Load model failed - error: Worker died
#3104 opened Apr 23, 2024 by geraldstanje
6
Update large_models/gpt_fast to llama3
#3102 opened Apr 22, 2024 by mreso
@mreso
Update large_models/tp_llama to llama3
#3101 opened Apr 22, 2024 by mreso
@mreso
Update large_models/inferentia2/llama2 to Llama3
#3100 opened Apr 22, 2024 by mreso
@lxning
ProTip! Adding no:label will show everything without a label.