Skip to content

Pull requests: vllm-project/vllm

New pull request New
443 Open 6,275 Closed
443 Open 6,275 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Doc] More neutral K8s deployment guide documentation Improvements or additions to documentation
#14084 opened Mar 2, 2025 by terrytangyuan Loading…
3
[V1] Simplify stats logging v1
#14082 opened Mar 1, 2025 by njhill Loading…
3
[v1] Refactor KVCacheConfig v1
#14079 opened Mar 1, 2025 by heheda12345 Loading…
@comaniac @WoosukKwon
1
[Misc] Update reasoning with stream example to use OpenAI library documentation Improvements or additions to documentation
#14077 opened Mar 1, 2025 by liuyanyi Loading…
1
[V1] Use Triton(ROCm) Attention backend as fallback for Turing GPUs rocm Related to AMD ROCm v1
#14071 opened Mar 1, 2025 by Isotr0py Loading…
4
[core] moe fp8 block quant tuning support
#14068 opened Mar 1, 2025 by divakar-amd Loading…
1
[Bugfix] Make memory profiler account for speculative draft model weights speculative-decoding
#14067 opened Feb 28, 2025 by benchislett Loading…
1
[Frontend] Allow return_tokens_as_token_ids to be passed as a request param frontend
#14066 opened Feb 28, 2025 by benchislett Loading…
2
Tune release tag to support release candidates ci/build
#14064 opened Feb 28, 2025 by atalman Loading…
1
[Misc] Accurately capture the time of loading weights ready ONLY add when PR is ready to merge/full CI is needed v1
#14063 opened Feb 28, 2025 by waltforme Loading…
5
[V1][Core] FlashInfer attention backend for V1 v1
#14061 opened Feb 28, 2025 by aurickq Loading…
11
[Distributed] Add reduce_scatter to DeviceCommunicatorBase
#14057 opened Feb 28, 2025 by tlrmchlsmth • Draft
1
[Docs] Add GPTQModel documentation Improvements or additions to documentation
#14056 opened Feb 28, 2025 by Qubitium Loading…
12
[WIP][[V1][Metrics] Implement max_num_generation_tokens metrics v1
#14055 opened Feb 28, 2025 by markmc • Draft
1
[Bugfix][Frontend] Strip empty tool calls from incoming chat conversations frontend
#14054 opened Feb 28, 2025 by benchislett Loading…
1
3
[Bugfix] Explicitly include "omp.h" for MacOS to avoid installation failure
#14051 opened Feb 28, 2025 by realShengYao • Draft
1
6
[Misc] Remove explicit mentioned code for whisper preprocess
#14049 opened Feb 28, 2025 by Isotr0py • Draft
1
[V1][Frontend] Improve Shutdown And Logs ci/build frontend ready ONLY add when PR is ready to merge/full CI is needed v1
#14048 opened Feb 28, 2025 by rafvasq Loading…
1
3
[Misc] Add fully interleaved support for multimodal 'string' content format frontend
#14047 opened Feb 28, 2025 by Dekakhrone Loading…
1
4
[V1] Avoid false positives when warning for unimplemented methods
#14046 opened Feb 28, 2025 by DarkLight1337 Loading…
1
[Kernel] Add more dtype support for GGUF kernels
#14043 opened Feb 28, 2025 by SzymonOzog Loading…
1
[Feature] Consolidate performance benchmark datasets
#14036 opened Feb 28, 2025 by JenZhao Loading…
@ywang96
2
[Misc] Modify xgrammar version ci/build
#14030 opened Feb 28, 2025 by shen-shanshan Loading…
1
[Bugfix] Fix Precision Mismatch in MoE Router of DeepSeek V2/V3 Models and Fused Kernels (BF16 -> FP32)
#14027 opened Feb 28, 2025 by DaizeDong Loading…
4
benchmark serving: random + sharegpt dataset
#14026 opened Feb 28, 2025 by seungrokj Loading…
4
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.