Pinned

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

   Python 2.3k 140

2. lm-sys/FastChat lm-sys/FastChat Public

   An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

   Python 33.9k 4.1k

3. cvc5/cvc5 cvc5/cvc5 Public

   cvc5 is an open-source automatic theorem prover for Satisfiability Modulo Theories (SMT) problems.

   SMT 936 224

4. S-LoRA/S-LoRA S-LoRA/S-LoRA Public

   S-LoRA: Serving Thousands of Concurrent LoRA Adapters

   Python 1.5k 74

5. FMInference/FlexGen FMInference/FlexGen Public

   Running large language models on a single GPU for throughput-oriented scenarios.

   Python 9k 522

6. FMInference/H2O FMInference/H2O Public

   [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

   Python 278 25