Skip to content

Pull requests: vllm-project/vllm

New pull request New
384 Open 4,536 Closed
384 Open 4,536 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Misc] Adding MMMU-Pro vision dataset to serving benchmark ready ONLY add when PR is ready to merge/full CI is needed
#10804 opened Dec 1, 2024 by ywang96 Loading…
2
[Core] add xgrammar as guided generation provider ci/build
#10803 opened Dec 1, 2024 by joennlae Loading…
1
[Bugfix] fix race condition that leads to wrong order of token returned
#10802 opened Dec 1, 2024 by joennlae Loading…
1
[Misc] Rename embedding classes to pooling frontend ready ONLY add when PR is ready to merge/full CI is needed
#10801 opened Dec 1, 2024 by DarkLight1337 Loading…
1
Fill TorchSDPAAttentionMetadata seq_lens_field for prefill
#10799 opened Nov 30, 2024 by maxdebayser Loading…
1
[LoRA] Change lora_tokenizers capacity
#10796 opened Nov 30, 2024 by xyang16 Loading…
1
[Model] Add BNB support to Llava and Pixtral-HF
#10795 opened Nov 30, 2024 by Isotr0py Loading…
1
1
Fix openvino on GPU
#10793 opened Nov 30, 2024 by janimo Loading…
1
[Hardware][CPU] Refactor CPU vector types for ISAs
#10787 opened Nov 30, 2024 by ShawnD200 Loading…
1
feat(guided): xgrammar support ci/build documentation Improvements or additions to documentation
#10785 opened Nov 29, 2024 by aarnphm Loading…
10
[Bugfix] Multiple fixes to tool streaming when using auto tool choice. frontend
#10782 opened Nov 29, 2024 by cedonley Loading…
1
5
[Model]: add some tests for aria model
#10770 opened Nov 29, 2024 by xffxff Loading…
@Isotr0py
3
[Platform] Move async output check to platform
#10768 opened Nov 29, 2024 by wangxiyuan Loading…
5
Drop ROCm load format check
#10767 opened Nov 29, 2024 by wangxiyuan Loading…
3
[feature]：upstream quark format to vllm needs-rebase
#10765 opened Nov 29, 2024 by kewang-xlnx Loading…
2
support download Lora Model from ModelScope and download private mode…
#10762 opened Nov 29, 2024 by AlphaINF Loading…
6
[Bugfix] Prevent benchmark_throughput.py from using duplicated random prompts
#10753 opened Nov 28, 2024 by mgoin Loading…
2
Configuration of the model parallelism does not make sense
#10749 opened Nov 28, 2024 by fajavadi Loading…
2
[Misc][XPU] Avoid torch compile for XPU platform ci/build
#10747 opened Nov 28, 2024 by yma11 Loading…
2
[Model] Add elementwise_affine to RMSNorm and re-enable weights loading tracker for Mamba
#10739 opened Nov 28, 2024 by Isotr0py Loading…
2
[doc]Update config docstring
#10732 opened Nov 28, 2024 by wangxiyuan Loading…
7
[Core] Refactoring disaggregated prefilling/decoding using Mooncake Transfer Engine ci/build documentation Improvements or additions to documentation frontend
#10728 opened Nov 28, 2024 by alogfans Loading…
4
[WIP][V1] Ray executor
#10725 opened Nov 27, 2024 by rkooo567 Loading…
2
[Bugfix] Fix BNB loader target_modules
#10720 opened Nov 27, 2024 by jeejeelee Loading…
2
[Model] Support Mantis(LLaVA) model ci/build documentation Improvements or additions to documentation needs-rebase
#10711 opened Nov 27, 2024 by DarkLight1337 • Draft
1
2
ProTip! Add no:assignee to see everything that’s not assigned.