Skip to content

Pull requests: triton-inference-server/client

New pull request New
26 Open 633 Closed
26 Open 633 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

triton generate support
#675 opened May 24, 2024 by nnshah1 • Draft
5
Fast PA teardown
#674 opened May 24, 2024 by tgerdesnv • Draft
Set add special tokens to false
#672 opened May 21, 2024 by IzzyPutterman Loading…
6
fix is_contiguous_logic issue in dlpack
#668 opened May 20, 2024 by wjddn279 Loading…
1
Ci updates
#665 opened May 17, 2024 by nvda-mesharma Loading…
Draft: WIP: Tokens to TRTLLM backend
#650 opened May 13, 2024 by IzzyPutterman • Draft
3
Update scaling from ns to ms
#639 opened May 9, 2024 by debermudez Loading…
7
Fixing memory leakage when using dlpack
#631 opened May 5, 2024 by ParshikovMM Loading…
3
return response metadata to associate it with request
#613 opened Apr 26, 2024 by sydnash Loading…
PA should check whether user-supplied inputs exist in the model
#612 opened Apr 25, 2024 by dyastremsky Loading…
@dyastremsky
4
[Windows] Support CPU shared memory (Client/Frontend)
#551 opened Mar 27, 2024 by fpetrini15 Loading…
20
Bugfix: get_response(as_json=True) now returns output
#477 opened Feb 28, 2024 by malcolmgreaves Loading…
Remove periodic concurrency feature
#464 opened Feb 1, 2024 by matthewkotila • Draft
3
Add gRPC stream client example for java
#441 opened Nov 28, 2023 by zhansg Loading…
Fixing compression imports in python aio client
#430 opened Nov 1, 2023 by thatsvishalhere Loading…
fix: Add missing import to aio support
#428 opened Oct 30, 2023 by AIvashov Loading…
1
add text bytes support
#426 opened Oct 26, 2023 by xxjwxc Loading…
1
Replace flatten with ravel to avoid unnecessary time cost of data copy
#376 opened Aug 2, 2023 by jokerz0624 Loading…
4
Close client in order to prevent file handle leak
#317 opened May 10, 2023 by michaelwechner Loading…
@jbkyang-nvi
2
add inferRequest capability to python clinet
#269 opened Mar 16, 2023 by andompesta Loading…
Add support for unix sockets
#247 opened Feb 16, 2023 by debermudez • Draft
Add support for unix sockets
#244 opened Feb 13, 2023 by roger652 Loading…
11
Python InferInput: set_data_from_numpy is not necessary in some cases.
#194 opened Nov 13, 2022 by RRoundTable Loading…
4
[Java] Add FP16 Support for Java Client
#79 opened Mar 3, 2022 by du00cs Loading…
5
Adding DtoD support to CUDA shared memory feature
#58 opened Jan 21, 2022 by rarzumanyan Loading…
13
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.