Skip to content

Pull requests: vllm-project/vllm

New pull request New
609 Open 7,940 Closed
609 Open 7,940 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix tmp_out and exp_sums dimensions
#17438 opened Apr 30, 2025 by hliuca Loading…
1
[benchmark][structured output] Add offline benchmark script for structured output needs-rebase structured-output
#17437 opened Apr 30, 2025 by lk-chen Loading…
2
fix missing _num_cached_tokens in subtract_num_batched_tokens
#17436 opened Apr 30, 2025 by initzhang Loading…
1
Make the _apply_rotary_emb compatible with dynamo
#17435 opened Apr 30, 2025 by houseroad Loading…
4
[Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' frontend
#17434 opened Apr 30, 2025 by chaunceyjiang Loading…
1
1
[Model] Support MiMo-7B inference with MTP needs-rebase
#17433 opened Apr 30, 2025 by bwshen-mi Loading… v0.9.0
2
Support LoRA for Mistral3 documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#17428 opened Apr 30, 2025 by mgoin Loading…
1
[V1] Allow turning off pickle fallback in vllm.v1.serial_utils v1
#17427 opened Apr 30, 2025 by russellb Loading…
3
[Feat] Add deprecated=True to CLI args
#17426 opened Apr 30, 2025 by aarnphm Loading…
3
[Fix] Support passing args to logger
#17425 opened Apr 29, 2025 by aarnphm Loading…
2
[Misc][AMD] Add query_platform method to interface.py
#17424 opened Apr 29, 2025 by rasmith Loading…
1
[Chore] import as annotations on config needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#17423 opened Apr 29, 2025 by aarnphm Loading…
3
add more pytorch related tests for torch nightly ci/build
#17422 opened Apr 29, 2025 by yangw-dev • Draft
2
[Feature][CLI] Unify configuration for structured outputs via --structured-output-config documentation Improvements or additions to documentation needs-rebase structured-output tool-calling v1
#17420 opened Apr 29, 2025 by aarnphm Loading…
14
Avoid overwriting vllm_compile_cache.py
#17418 opened Apr 29, 2025 by youngkent Loading…
3
[DO NOT MERGE] Manual Fusion PR for Comparison
#17417 opened Apr 29, 2025 by rasmith Loading…
1
Fix noisy warning for uncalibrated q_scale/p_scale
#17414 opened Apr 29, 2025 by mgoin Loading…
2
[Model] Uses vllm_flash_attn for Qwen 2 VL catalogs of models
#17413 opened Apr 29, 2025 by aarnphm Loading…
1
[Bugfix] Temporarily disable gptq_bitblas on ROCm documentation Improvements or additions to documentation
#17411 opened Apr 29, 2025 by nlzy Loading…
1
3
[Frontend] Fix tool_call handling in llama3.1 and llama3.2 chat template to allow zero tool_calls documentation Improvements or additions to documentation tool-calling
#17409 opened Apr 29, 2025 by CatherineSue Loading…
1
[Bugfix] Fixed prompt length for random dataset
#17408 opened Apr 29, 2025 by Xarbirus Loading…
1
[CI/Build] Fix docker command casing warning ci/build
#17403 opened Apr 29, 2025 by Luohaothu Loading…
1
Revert "[NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032)" ci/build
#17402 opened Apr 29, 2025 by Alexei-V-Ivanov-AMD Loading…
4
Remove Zephyr 7B from everywhere possible in CI ready ONLY add when PR is ready to merge/full CI is needed structured-output
#17401 opened Apr 29, 2025 by hmellor Loading…
3
[v1][Spec Decode] Make sliding window compatible with eagle prefix caching v1
#17398 opened Apr 29, 2025 by heheda12345 Loading…
1
ProTip! Add no:assignee to see everything that’s not assigned.