Skip to content

Pull requests: vllm-project/vllm

New pull request New
329 Open 2,529 Closed
329 Open 2,529 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix speculative decode seeded test
#6743 opened Jul 24, 2024 by njhill Loading…
2
[Frontend] split run_server into build_server and run_server
#6740 opened Jul 24, 2024 by dtrifiro • Draft
1
[Model][Jamba] Mamba cache single buffer ready
#6739 opened Jul 24, 2024 by mzusman Loading…
2
Update logits processor with tensor caching
#6715 opened Jul 24, 2024 by lynkz-matt-psaltis • Draft
1
[Core] Tweaks to model runner/input builder developer APIs ready
#6712 opened Jul 24, 2024 by Yard1 Loading…
5
[CI/Build] Build wheel in release model when sccache is not enabled ready
#6710 opened Jul 23, 2024 by zifeitong Loading…
3
[CORE] support for *.pt type prompt adapters
#6709 opened Jul 23, 2024 by prashantgupta24 Loading…
2
[CI] [nightly benchmark] Do not re-download sharegpt dataset if exists ready
#6706 opened Jul 23, 2024 by cadedaniel Loading…
2
[BugFix] Fix use of per-request seed with pipeline parallel
#6698 opened Jul 23, 2024 by njhill • Draft
1
2
[Core] Add allgather comm for PP
#6695 opened Jul 23, 2024 by aurickq Loading…
8
[Bugfix] Miscalculated latency lead to time_to_first_token_seconds inaccurate. ready
#6686 opened Jul 23, 2024 by AllenDou Loading…
1
@comaniac
6
[mypy] Enable following imports for some directories ready
#6681 opened Jul 23, 2024 by DarkLight1337 Loading…
1
[Misc] Revert Patch for Chameleon ready
#6679 opened Jul 23, 2024 by ywang96 Loading…
2
[ Kernel ] Tuned FP8 Kernels for Ada Lovelace ready
#6677 opened Jul 23, 2024 by varun-sundar-rabindranath Loading…
5
[Kernels] Add fp8 support to reshape_and_cache_flash ready
#6667 opened Jul 23, 2024 by Yard1 Loading…
@comaniac @robertgshaw2-neuralmagic
12
[Draft] [Speculative decoding] Use SPMD worker to reduce control plane communication ready
#6664 opened Jul 23, 2024 by cadedaniel • Draft
1
[Misc] Fix attribute error when accessing compiled_dag ready
#6663 opened Jul 22, 2024 by ruisearch42 Loading…
2
[Misc] Increase default chunk size to 2048
#6662 opened Jul 22, 2024 by WoosukKwon • Draft
3
Llama3 Inference Optimization
#6658 opened Jul 22, 2024 by sfc-gh-reyazda • Draft
@robertgshaw2-neuralmagic
6
[DOC] Correct warning about performance
#6654 opened Jul 22, 2024 by casper-hansen Loading…
1
9
[Kernel] Add dynamic asymmetric quantization kernel
#6651 opened Jul 22, 2024 by ProExpertProg • Draft
1
[ CI ] Awq Marlin Integration Tests ready
#6627 opened Jul 22, 2024 by robertgshaw2-neuralmagic Loading…
2
[Frontend] Represent tokens with identifiable strings ready
#6626 opened Jul 21, 2024 by ezliu Loading…
9
[Core][VLM] Support image embeddings as input
#6613 opened Jul 21, 2024 by ywang96 • Draft
1
@DarkLight1337
6
[Model] Support Nemotron ready
#6611 opened Jul 20, 2024 by mgoin Loading…
1
5
ProTip! Follow long discussions with comments:>50.