Skip to content

Pull requests: vllm-project/vllm

New pull request New
622 Open 8,235 Closed
622 Open 8,235 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

[FEAT] [ROCm] [V1]: Add AITER biased group topk for DeepSeekV3
#17955 openedMay 11, 2025by vllmellm Loading…
 1
[Bugfix] When use set rope_scaling should replace it
#17953 openedMay 11, 2025by lengrongfu Loading…
1
3
Refactor ci/build needs-rebase tpuRelated to Google TPUsv1
#17950 openedMay 10, 2025by yarongmu-google • Draft
 2
[Bugfix] Add revision to transformers.Auto*.from_pretrained processors readyONLY add when PR is ready to merge/full CI is needed
#17948 openedMay 10, 2025by xinli-centml Loading…
 2
[v1] Support multiple KV cache groups in GPU model runner tpuRelated to Google TPUsv1
#17945 openedMay 10, 2025by heheda12345 Loading…
 2
[doc] list the hf downloaded models documentationImprovements or additions to documentation
#17940 openedMay 10, 2025by reidliu41 Loading…
 1
[WIP] Fix Misleading Error Messages
#17938 openedMay 10, 2025by mengbingrock Loading…
1
1
[BugFix] Correct max_model_len derivation from config.json for Mistral format
#17937 openedMay 10, 2025by princepride Loading…
1
3
[doc] update lora doc documentationImprovements or additions to documentationreadyONLY add when PR is ready to merge/full CI is needed
#17936 openedMay 10, 2025by reidliu41 Loading…
 2
[Bugfix] Avoid repeatedly creating dummy data during engine startup multi-modalityRelated to multi-modality (#4194)v1
#17935 openedMay 10, 2025by DarkLight1337 Loading…
 1
[kernel] integrate permute/unpermute kernel into deepgemm moe
#17934 openedMay 10, 2025by CalebDu Loading…
 2
[Misc][RFC] Add automated profiling sweep and heatmap visualization tools
#17933 openedMay 10, 2025by ConstBob Loading…
1
1
[WIP] automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. ci/build
#17930 openedMay 10, 2025by louie-tsai Loading…
 1
[BugFix] Set default random seed to 0 for V1
#17929 openedMay 10, 2025by WoosukKwon Loading…
 2
[Frontend] [Core] Add Tensorizer support for LoRA adapter serialization and deserialization documentationImprovements or additions to documentation
#17926 openedMay 9, 2025by sangstar Loading…
@jeejeelee
 1
[WIP][Misc] Add Ray Prometheus logger to V1 v1
#17925 openedMay 9, 2025by eicherseiji Loading…
 3
TESTING CI test completion - no need to merge. ci/build needs-rebase
#17921 openedMay 9, 2025by Alexei-V-Ivanov-AMD Loading…
 2
[Hardware][Intel-Gaudi] enable text embedding for Intel-Gaudi backend
#17920 openedMay 9, 2025by libinta Loading…
 1
[Draft] Support PIL Image in llm.chat frontend
#17919 openedMay 9, 2025by ywang96 • Draft
1
1
use ceil_div in cutlass block scaling shape check
#17918 openedMay 9, 2025by IwakuraRein Loading…
 1
WIP: fix_llama4_tool_call documentationImprovements or additions to documentationfrontend tool-calling
#17917 openedMay 9, 2025by wukaixingxp • Draft
 4
[Bugfix][V1] Only get input embeddings w/ multi-modal models if first PP readyONLY add when PR is ready to merge/full CI is neededv1
#17916 openedMay 9, 2025by jinhuang12 Loading…
 3
[Misc] Add compressed-tensors NVFP4A16 emulation support quantization readyONLY add when PR is ready to merge/full CI is needed
#17914 openedMay 9, 2025by dsikka Loading…
 2
[BugFix][AMD] Compatible for AITER lib after 04/20
#17912 openedMay 9, 2025by qli88 Loading…
 1
[Bugfix] add missing function params to rocm_aiter_mla.py v1
#17911 openedMay 9, 2025by davidxia • Draft
 7
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.