 Sy03
|
bcb2386af1
|
[Model] Keep CosyVoice3 defaults compatible without CUDA MPS
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-03 01:07:14 +08:00 |
|
|
Sy03
|
5954ce5500
|
[Model] Use the optimized CosyVoice3 streaming default on H200
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-03 00:28:25 +08:00 |
|
|
Zheng Wengangandamy-why-3459
|
eb1699bfca
|
[FEAT][Fronted] Support incremental prefill for realtime video streaming (#5894)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-02 22:18:51 +08:00 |
|
|
Sy03
|
e84014dffb
|
[Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 21:34:30 +10:00 |
|
|
Rahul Steiger
|
596487fe62
|
[Core] Prototype diffusion attention execution contracts with FA4 (#7379)
|
2026-10-02 17:58:47 +08:00 |
|
|
MaciejBalaNVand汪志鹏
|
97d6c693a6
|
[feature] Add HSDP pre-sharded option (#7948)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-10-02 09:35:09 +00:00 |
|
|
Sy03
|
d93e1a8e09
|
[Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-01 22:22:54 -07:00 |
|
|
Youyuan Liandprincepride
|
423f34326e
|
[Model] Add YuE2-3B text-to-music (model + /v1/audio/speech adapter) (#7886)
Signed-off-by: Youyuan Li <105433145+Darcy-Lee@users.noreply.github.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-10-01 18:04:31 +08:00 |
|
|
WeiQing Chen
|
e34f8c4f42
|
[Doc] Update vLLM-Omni WeChat QR code (#8301)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-09-30 11:39:05 +08:00 |
|
|
Mu GuanLinandHongsheng Liu
|
3a82c85880
|
[Experimental][Perf] Eliminate redundant host copies from generated-video transport (#7355)
Signed-off-by: mglyn <1203789601@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-30 11:37:57 +08:00 |
|
|
|
35cf6ac355
|
[Feat][Perf][AuK]Support Online Serving and DiT CUDAGraph (#7469)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-30 00:18:38 +00:00 |
|
|
Sy03
|
5af3a16526
|
[Model] Add MiniCPM-o 4.5 turn-mode MRv2 and batched audio inference (#8222)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 11:41:39 -07:00 |
|
|
Sy03
|
001f8a80b9
|
[Core] Extend the shared multi-stage execution framework for mixed V1/MRv2 pipelines (#8184)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 07:40:57 -07:00 |
|
|
|
7d6904aa94
|
SeedVR2: bounded long-video restoration (#8102)
Signed-off-by: 0z5a <Dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-09-29 11:33:50 +00:00 |
|
|
Canlin Guo
|
235c430326
|
[Frontend] Tune reference cache limits and registered MOSS voice requests (#7883)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-09-29 04:10:17 +00:00 |
|
|
BeatSeat
|
3e62bba3cb
|
[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)
|
2026-09-29 09:14:12 +10:00 |
|
|
RuQing Xu
|
0173cb3748
|
[Kernel] Improve 2 backends importing FlashInfer: FLASHINFER_ATTN and TRTLLM_ATTN (#7431)
Signed-off-by: Ruqing Xu <7891482+xrq-phys@users.noreply.github.com>
|
2026-09-28 21:21:58 +00:00 |
|
|
vraiti
|
d31dbc5b0a
|
[Frontend] OpenAI-compliant fullduplex /v1/realtime with Qwen3-Omni support (#7285)
Signed-off-by: vraiti <vraiti@redhat.com>
|
2026-09-28 20:14:05 +00:00 |
|
|
vOv
|
a07384b953
|
[Bugfix] Raise when a diffusion stage fails sleep or wake_up (#7811)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
|
2026-09-29 00:12:34 +08:00 |
|
|
DMANandHongsheng Liu
|
79a46a4f54
|
[Perf][Diffusion] support Sensenova online fp8 (#7955)
Signed-off-by: Dmaner <2663515256@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-28 23:17:37 +08:00 |
|
|
Ding Zuhao
|
1b97ff1188
|
[Model] Support SenseNova-U1-A3B-MoT (MoE) (#8172)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
|
2026-09-27 08:48:08 +00:00 |
|
|
|
798d52ce55
|
[Core][Model] Fit PersonaPlex into the Unified Full-duplex Framework (RFC #7181 PR 2) (#7695)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-27 03:02:24 +00:00 |
|
|
Hongsheng Liuandhsliu_ustc
|
7ab582ae25
|
[Doc] Update README and docs for v0.30.0 (#8175)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
|
2026-09-27 10:07:58 +08:00 |
|
|
R0CKSTAR
|
6715c57b2d
|
feat: configure Torch Dynamo recompile limit from environment (#7243)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-09-26 22:54:47 +08:00 |
|
|
Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Anjie HouandHongsheng Liu
|
8a49c65bf9
|
[Core][Diffusion] Add byte backpressure to chunk transfers (#7916)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-26 17:48:32 +08:00 |
|
|
Joshna-Medisetty
|
62ebad2d7c
|
Add Intel Arc BMG recipes for validated P0 diffusion models. (#7537)
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com>
|
2026-09-25 15:42:08 -05:00 |
|
|
Sy03
|
d31a2a3ba8
|
[Bugfix] Fix Nemotron VoiceChat duplex nightly handshake (#7884)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-25 17:25:15 +00:00 |
|
|
Gao Han
|
69de153f6e
|
[Bugfix] Stop cancelled MiniMax-H3 requests at denoising boundaries (#7844)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-25 13:36:09 +08:00 |
|
|
|
9e7e3a802c
|
[Bugfix] Compensate cancelled duplex open, append and resume; fix serving README drift (#7636 Issues 1, 2, 3, 21) (#7785)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-09-24 19:23:08 -07:00 |
|
|
Isotr0py
|
7b4dc7633b
|
[Doc] Announce PR limitation to avoid agent spam (#8131)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-24 09:58:57 -07:00 |
|
|
|
535bd35b42
|
[Perf] Add reusable exact projection caching with MiniMax-H3 integration (#7987)
Signed-off-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
Co-authored-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: Armaan Amatya <38102001+armaanamatya@users.noreply.github.com>
|
2026-09-24 23:30:42 +08:00 |
|
|
ZacheryAUandGao Han
|
926ba72793
|
[Frontend][Benchmark] Add judger and accuracy metrics for OmniInterac… (#7317)
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 08:34:23 +00:00 |
|
|
Haozhe Jiang
|
dbd6a35dd2
|
[Bugfix] Reject partially bound diffusion LoRA adapters (#8008)
Signed-off-by: Haozhe Jiang <162801044+provoke210@users.noreply.github.com>
|
2026-09-24 15:28:00 +08:00 |
|
|
Honghan ZhuandGao Han
|
67aa30c966
|
[Bugfix] Align MiniMax-H3 inference steps with denoiser evaluations (#7219)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 03:56:38 +00:00 |
|
|
Yukim1
|
205aa01c7b
|
[Diffusion][HunyuanImage3] Add request paged prefix caching (#7719)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-09-23 15:34:56 +00:00 |
|
|
Weiming Liao
|
81bc7116c1
|
[NPU] upgrade to v0.30.0 (#8027)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
|
2026-09-23 14:59:29 +00:00 |
|
|
Yuan WuandHongsheng Liu
|
cb5f508212
|
[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-23 18:26:53 +08:00 |
|
|
Yueqian Lin
|
3f473a358b
|
[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)
|
2026-09-22 17:10:15 -07:00 |
|
|
MaciejBalaNV
|
7d6e2ade6c
|
[bugfix] Fix FP8 Quack kernels when using Context Parallelism and reduce number of recompilations (#7458)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
|
2026-09-22 11:38:17 -07:00 |
|
|
MaciejBalaNV
|
c482626450
|
[optimization] Added Wan 2.2 VAE decode optimizations (#7056)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
|
2026-09-22 11:37:49 -07:00 |
|
|
Deep Shah
|
b44cf97b31
|
[Bugfix] Preserve all video-stream audio deltas (#7532)
Signed-off-by: Deep Shah <deep@socratic.co>
|
2026-09-22 10:19:16 -07:00 |
|
|
|
59db6a4285
|
[Rebase] Rebase to vLLM 0.30.0 (#7820)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-22 15:52:01 +00:00 |
|
|
yanbao1217andyanbao1217
|
ca14e635f5
|
[Doc] Correct the SessionClosed admission-slot guarantee (#7636 Issue 22) (#7869)
Signed-off-by: yanbao1217 <yanliuwebsite493@gmail.com>
Co-authored-by: yanbao1217 <yanliuwebsite493@gmail.com>
|
2026-09-22 14:57:50 +00:00 |
|
|
Wang fuyin
|
303edff930
|
[Doc][skip ci] Add design doc for scheduler-managed diffusion paged KV cache (#6891)
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
|
2026-09-22 10:53:37 +08:00 |
|
|
wangyu
|
0570b0da7e
|
[CI][Perf] migrate diffusion DFX benches to vllm bench serve --omni (#7737)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-09-21 19:16:39 -07:00 |
|
|
Hoseung KimandHoseung Kim
|
d4570afabf
|
[Frontend] Reject built-in name collisions in voice upload and add VLLM_OMNI_SPEAKER_REGISTRATION_POLICY (#6848)
Signed-off-by: Hoseung Kim <hoseung.kim@navercorp.com>
Co-authored-by: Hoseung Kim <hoseung.kim@navercorp.com>
|
2026-09-21 18:35:07 -07:00 |
|
|
Armaan Amatya
|
cb31e0774f
|
[Misc] Deprecate VLLM_OMNI_VOXCPM_CODE_PATH (#7779)
Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
|
2026-09-21 18:34:31 -07:00 |
|
|
shihongzhi
|
c11596c637
|
[Model] MammothModa2: enable Cache-DiT acceleration for the DiT stage (#7291)
Signed-off-by: shihongzhi <shi65881583@gmail.com>
|
2026-09-21 18:34:12 -07:00 |
|
|
Sy03
|
473da2cf82
|
[Perf][Qwen3-TTS] Enable event-driven orchestration by default (#7088)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 12:09:19 -07:00 |
|