Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
8 Open 799 Closed
8 Open 799 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

implement Open Inference Protocol endpoints
#1942 opened May 23, 2024 by drbh • Draft
[Major Change][Undecided yet] Move to FlashDecoding instead of PagedAttention kernel.
#1940 opened May 23, 2024 by Narsil Loading…
5 tasks
Cpu tgi
#1936 opened May 23, 2024 by sywangyi Loading…
5 tasks
7
feat: experimental python packaging and interface
#1912 opened May 16, 2024 by drbh • Draft
4 tasks
4
feat: move allocation logic to rust
#1835 opened Apr 30, 2024 by OlivierDehaene Loading…
Enable testing TGI on XPU
#1832 opened Apr 30, 2024 by mfuntowicz Loading…
Enhance AsyncClient for Flexible Session Management in Text Generation Client
#1784 opened Apr 21, 2024 by BenHaimItay Loading…
4 tasks done
2
add ascend npu support for TGI Stale
#1740 opened Apr 14, 2024 by statelesshz • Draft
5 tasks
ProTip! Follow long discussions with comments:>50.