Skip to content

Pull requests: vllm-project/vllm

New pull request New
683 Open 8,871 Closed
683 Open 8,871 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix benchmark_moe.py
#19016 opened Jun 2, 2025 by gty111 Loading…
1
[v1][KVCacheManager] Rename BlockHashType to BlockHash documentation Improvements or additions to documentation v1
#19015 opened Jun 2, 2025 by heheda12345 Loading…
1
[draft] add some nvtx ranges for vllm for diagnostic documentation Improvements or additions to documentation needs-rebase speculative-decoding v1
#19011 opened Jun 2, 2025 by simon-mo • Draft
2
[doc] add pytest tips documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#19010 opened Jun 2, 2025 by reidliu41 Loading…
1
[WIP][Bugfix] fix python setup.py develop ci/build
#19009 opened Jun 2, 2025 by houseroad • Draft
1
fix prefix caching logic for running requests without speculative tokens v1
#19006 opened Jun 1, 2025 by yuguo68 Loading…
3
[nvidia] add support mig device
#19003 opened Jun 1, 2025 by lengrongfu • Draft
1
1
[doc] small fix - serve_args.md documentation Improvements or additions to documentation
#18999 opened Jun 1, 2025 by reidliu41 Loading…
4
[DRAFT] Self-Speculative Decoding using LayerSkip documentation Improvements or additions to documentation needs-rebase speculative-decoding v1
#18994 opened May 31, 2025 by aniltolwani • Draft
2
[ROCm] [AITER] [Bugfix] Patch for AITER commit 648764942e552a8bb5fe16026703716a81f05374 ci/build
#18990 opened May 31, 2025 by tjtanaa Loading…
2
[Benchmark] Add hf_stream arg to enable or disable datasets streaming loading
#18989 opened May 31, 2025 by Potabk Loading…
4
Add tarsier model support documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194)
#18985 opened May 31, 2025 by princepride Loading…
17
Fix FlashMLA detection in ray environment
#18979 opened May 30, 2025 by eicherseiji Loading…
1
[Bugfix][Model] Attempt to fix eagle in V0. ready ONLY add when PR is ready to merge/full CI is needed
#18978 opened May 30, 2025 by gshtras Loading…
6
[BugFix][V1] Fix memory profiling bug v1
#18974 opened May 30, 2025 by ProExpertProg Loading…
6
[Core] Remove unnecessary copy of multi modal input embeddings v1
#18973 opened May 30, 2025 by lgeiger Loading…
3
[V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix
#18971 opened May 30, 2025 by ekagra-ranjan Loading…
2
Reduce logs in CLI scripts and plugin loader
#18970 opened May 30, 2025 by mgoin Loading…
2
[Performance] Replace per-tensor/token FP8 quant CUDA kernels with torch.compile
#18965 opened May 30, 2025 by mgoin • Draft
1
[Bugfix][Core] Prefix caching enabled causes incorrect outputs
#18957 opened May 30, 2025 by quanliu1991 Loading…
1
3
[Core] hybrid dtype for Pooling Models: float32 for weights and activation, float16 or bfloat16 for attention. ci/build tpu Related to Google TPUs v1
#18940 opened May 30, 2025 by noooop Loading…
3
Abstract mooncake store connector to kv store connector
#18936 opened May 30, 2025 by maobaolong Loading…
3
[Bugfix][Config] Fix config dtype get error needs-rebase
#18934 opened May 30, 2025 by MengqingCao Loading…
4
Adding "LoRA Test %N" to AMD production tests ci/build rocm Related to AMD ROCm
#18929 opened May 29, 2025 by Concurrensee Loading…
1
feat: add data parallel rank to KVEventBatch documentation Improvements or additions to documentation v1
#18925 opened May 29, 2025 by PeaBrane Loading…
1
11
ProTip! Mix and match filters to narrow down what you’re looking for.