Skip to content

Pull requests: vllm-project/vllm

New pull request New
605 Open 7,964 Closed
605 Open 7,964 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCacheManager v1
#17479 opened Apr 30, 2025 by heheda12345 • Review required
1
Bump Compressed Tensors version to 0.9.4 ci/build ready ONLY add when PR is ready to merge/full CI is needed
#17478 opened Apr 30, 2025 by rahul-tuli • Approved
2
[v1] Move block management logic from KVCacheManager to SpecializedManager needs-rebase v1
#17474 opened Apr 30, 2025 by heheda12345 • Review required
2
fix: vllm serve on Apple silicon
#17473 opened Apr 30, 2025 by davidxia • Review required
1
fix: restore http metrics for V0 engine v1
#17471 opened Apr 30, 2025 by davidxia • Draft
1
7
[Misc] refactor example - cpu_offload_lmcache documentation Improvements or additions to documentation
#17460 opened Apr 30, 2025 by reidliu41 • Review required
1
[CI/Build] Reorganize models tests ci/build multi-modality Related to multi-modality (#4194)
#17459 opened Apr 30, 2025 by DarkLight1337 • Approved
2
Improve configs - ObservabilityConfig needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#17453 opened Apr 30, 2025 by hmellor • Review required
6
[Feature][Frontend]: Deprecate --enable-reasoning documentation Improvements or additions to documentation frontend structured-output tool-calling
#17452 opened Apr 30, 2025 by chaunceyjiang • Changes requested
1
33
Fix more broken speculative decode tests ready ONLY add when PR is ready to merge/full CI is needed speculative-decoding
#17450 opened Apr 30, 2025 by huydhn • Approved
2
[Bugfix] Fix TritonPlaceholder conflicts with torch.compile v1
#17446 opened Apr 30, 2025 by MengqingCao • Draft
1
[benchmark][structured output] Add offline benchmark script for structured output structured-output
#17440 opened Apr 30, 2025 by lk-chen • Review required
1
fix tmp_out and exp_sums dimensions
#17438 opened Apr 30, 2025 by hliuca • Review required
1
fix missing _num_cached_tokens in subtract_num_batched_tokens
#17436 opened Apr 30, 2025 by initzhang • Review required
1
[Model] Support MiMo-7B inference with MTP needs-rebase
#17433 opened Apr 30, 2025 by bwshen-mi • Review required v0.9.0
3
[V1] Allow turning off pickle fallback in vllm.v1.serial_utils ready ONLY add when PR is ready to merge/full CI is needed v1
#17427 opened Apr 30, 2025 by russellb • Approved
3
[Feat] Add deprecated=True to CLI args
#17426 opened Apr 30, 2025 by aarnphm • Review required
6
[Misc][AMD] Add query_platform method to interface.py
#17424 opened Apr 29, 2025 by rasmith • Review required
1
add more pytorch related tests for torch nightly ci/build
#17422 opened Apr 29, 2025 by yangw-dev • Draft
2
[Feature][CLI] Unify configuration for structured outputs via --structured-output-config documentation Improvements or additions to documentation needs-rebase structured-output tool-calling v1
#17420 opened Apr 29, 2025 by aarnphm • Changes requested
14
Avoid overwriting vllm_compile_cache.py ready ONLY add when PR is ready to merge/full CI is needed
#17418 opened Apr 29, 2025 by youngkent • Approved
6
[DO NOT MERGE] Manual Fusion PR for Comparison
#17417 opened Apr 29, 2025 by rasmith • Review required
1
Fix noisy warning for uncalibrated q_scale/p_scale
#17414 opened Apr 29, 2025 by mgoin • Review required
2
[Bugfix] Temporarily disable gptq_bitblas on ROCm documentation Improvements or additions to documentation
#17411 opened Apr 29, 2025 by nlzy • Review required
1
3
[Frontend] Fix tool_call handling in llama3.1 and llama3.2 chat template to allow zero tool_calls documentation Improvements or additions to documentation tool-calling
#17409 opened Apr 29, 2025 by CatherineSue • Review required
1
ProTip! Follow long discussions with comments:>50.