Skip to content

Issues: triton-inference-server/server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

409 Open 3,073 Closed
409 Open 3,073 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[tensorrt-llm backend] A question about launch_triton_server.py
#7211 opened May 13, 2024 by victorsoda
Questions about serving PyTorch LLM in Python backend with token streaming using "Decoupled Mode" question Further information is requested
#7210 opened May 12, 2024 by jackylu0124
3
How to enable nsys when starting a Triton server using Python API question Further information is requested
#7209 opened May 11, 2024 by jerry605
1
Ragged Batching is not working proberbly
#7206 opened May 10, 2024 by AWallyAllah
Query Regarding Custom Metrics For Python Backend question Further information is requested
#7204 opened May 10, 2024 by AniForU
1
Perf_analyzer reported metrics for decoupled model
#7203 opened May 10, 2024 by ZhanqiuHu
Triton Server OpenVINO backend not working with Tensorflow saved models bug Something isn't working
#7200 opened May 9, 2024 by atobiszei
5
triton infer server docker image not working on Jetson Orin NX 16 GB JP 5.1.1
#7199 opened May 9, 2024 by allan-navarro
2
Metrics Port Not Opening with Triton Inference Server's In-Process Python API
#7197 opened May 8, 2024 by yucai
1
GRPC infer returns null in outputs contents
#7191 opened May 7, 2024 by aohorodnyk
2
Memory leak with multiple GPU and BLS.
#7190 opened May 7, 2024 by kbegiedza
1
Unexpected reshaping of output
#7189 opened May 7, 2024 by lemousehunter
1
How to specify the TensorRT version in Triton Server for inference? question Further information is requested
#7188 opened May 7, 2024 by Gcstk
2
grpc request performance issue
#7187 opened May 7, 2024 by Yuyaying-winnie
1
Cannot use model-analyzer on ONNX classification model with dynamic input question Further information is requested
#7184 opened May 6, 2024 by siretru
3
Dynamically Limit Endpoint Access enhancement New feature or request
#7183 opened May 5, 2024 by amoosebitmymom
2
Is onnxruntime-genai supported? question Further information is requested
#7182 opened May 4, 2024 by jackylu0124
2
ORT-TRT backend uses too much CPU memory
#7180 opened May 2, 2024 by ShuaiShao93
1
Unable to use triton client with shared memory in C++ (Jetpack 6 device) module: platforms Issues related to platforms, hardware, and support matrix
#7177 opened May 1, 2024 by ganeshmojow
1
Manually update model repository index
#7173 opened Apr 30, 2024 by vilkkiE
@nnshah1
5
Input data/shape validation bug Something isn't working question Further information is requested
#7171 opened Apr 29, 2024 by HennerM
1
@jbkyang-nvi
7
Python Backend: one model instance over multiple GPUs
#7169 opened Apr 29, 2024 by CollinHU
2
Perf Analyzer Error: Cannot send stop request without specifying a request_id
#7168 opened Apr 28, 2024 by MuyeMikeZhang
1
[Question] Is it possible to shutdown Triton if we detect certain cuda errors ?
#7164 opened Apr 26, 2024 by MatthieuToulemont
1
does triton support different model-repository assemble into a batch?
#7159 opened Apr 25, 2024 by tricky61
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.