kserve kserve Ideas · Discussions · GitHub

Welcome to KServe Discussions!
Q&A yuzisun

Sort by: Latest activity

Categories

Ideas Discussions

Share ideas for new features

You must be logged in to vote

Thoughts on adding some LLM specific runtime?

Peilun-Li started Aug 25, 2023 in Ideas

0
You must be logged in to vote

Thoughts on continuous batching?

Peilun-Li started May 19, 2023 in Ideas

0
You must be logged in to vote

Add huggingface mlserver runtime.

ajsalow started Dec 8, 2022 in Ideas

0
You must be logged in to vote

Propagate headers to all steps in inference graphs

rachitchauhan43 started Jul 5, 2022 in Ideas

0
You must be logged in to vote

Inference Graph API variation proposal

njhill started May 2, 2022 in Ideas

2