Skip to content

Pull requests: vllm-project/vllm

New pull request New
262 Open 1,828 Closed
262 Open 1,828 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[BugFix]Fix the problem that StopChecker assumes a single token produ…
#5243 opened Jun 4, 2024 by IcyFeather233 Loading…
[Kernel] Add back batch size 1536 and 3072 to MoE tuning
#5242 opened Jun 4, 2024 by WoosukKwon Loading…
[CI/Build] Reducing CPU CI execution time
#5241 opened Jun 4, 2024 by bigPYJ1151 Loading…
[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100
#5238 opened Jun 4, 2024 by pcmoritz Loading…
3
[Frontend] Add OpenAI Vision API Support
#5237 opened Jun 4, 2024 by ywang96 • Draft
4
10
Bugfix: fix broken of download models from modelscope
#5233 opened Jun 3, 2024 by liuyhwangyh Loading…
1
[Model] Correct Mixtral FP8 checkpoint loading
#5231 opened Jun 3, 2024 by comaniac Loading…
1
[Core][Doc] Default to multiprocessing for single-node distributed case
#5230 opened Jun 3, 2024 by njhill Loading…
2
5
[Bugfix] Fix prompt_logprobs when SamplingParams.detokenize is set to True
#5226 opened Jun 3, 2024 by zifeitong Loading…
@DarkLight1337
1
[Misc] Adding Speculative decoding to Throughput Benchmarking script
#5223 opened Jun 3, 2024 by abhibambhaniya Loading…
1
Support W4A8 quantization for vllm
#5218 opened Jun 3, 2024 by HandH1998 Loading…
@robertgshaw2-neuralmagic
3
[Core] Registry for processing model inputs
#5214 opened Jun 3, 2024 by DarkLight1337 Loading…
@rkooo567
[BugFix] Apply get_cached_tokenizer to the tokenizer setter of LLM
#5207 opened Jun 3, 2024 by DriverSong Loading…
2
6
[Frontend] Customizable RoPE theta
#5197 opened Jun 2, 2024 by sasha0552 Loading…
[Misc] Improve error message when LoRA parsing fails
#5194 opened Jun 2, 2024 by DarkLight1337 Loading…
2
[Core] Support loading GGUF model
#5191 opened Jun 2, 2024 by Isotr0py • Draft
1 of 4 tasks
2
[Model] Add PaliGemma
#5189 opened Jun 2, 2024 by ywang96 • Draft
1
[Core][Prefix Caching] Fix hashing logic for non-full blocks
#5188 opened Jun 2, 2024 by zhuohan123 Loading…
@rkooo567
1
[Bugfix] [Frontend] vLLM api_server.py when using with prompt_token_ids causes error.
#5187 opened Jun 1, 2024 by TikZSZ Loading…
1
[Kernel] Switch fp8 layers to use the CUTLASS kernels
#5183 opened Jun 1, 2024 by tlrmchlsmth • Draft
17
[Model] LoRA support added for command-r
#5178 opened Jun 1, 2024 by sergey-tinkoff Loading…
1
draft2
#5175 opened Jun 1, 2024 by khluu • Draft
bug fixed: cuda out of memory lead to 'AsyncEngineDeadError: Background loop has errored already.
#5173 opened Jun 1, 2024 by charent Loading…
3
2
[Bugfix] Fix illegal memory access for lora
#5169 opened May 31, 2024 by sfc-gh-zhwang • Draft
1
@rkooo567
2
[Bugfix] Fix KeyError: 1 When Using LoRA adapters
#5164 opened May 31, 2024 by BlackBird-Coding Loading…
1
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.