 Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Sy03
|
d31a2a3ba8
|
[Bugfix] Fix Nemotron VoiceChat duplex nightly handshake (#7884)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-25 17:25:15 +00:00 |
|
|
Yuanheng Zhao
|
3bd5ac9685
|
[Bugfix] Align Ming-Image prompt templates and RNG, fix number of layer to decompose (#8118)
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com>
|
2026-09-25 22:47:29 +08:00 |
|
|
|
9e7e3a802c
|
[Bugfix] Compensate cancelled duplex open, append and resume; fix serving README drift (#7636 Issues 1, 2, 3, 21) (#7785)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-09-24 19:23:08 -07:00 |
|
|
|
0295eeb6f3
|
[Orchestrator] Implement cache reset RPC forwarding to AR stage engine cores (#6766)
Signed-off-by: Asthenia <asthenia0412@gmail.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Asthenia <asthenia0412@gmail.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 15:32:07 +00:00 |
|
|
wuli666
|
6daf5b30f0
|
[Bugfix] Preserve cancellation in duplex session control queues (#7782)
Signed-off-by: wuli666 <421774554@qq.com>
|
2026-09-23 19:32:40 +00:00 |
|
|
Zhou Taichang
|
d38566ae80
|
[Bugfix][Core] Fix stage initialization spawn-lock/device-lock inversion (#7926)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-09-23 17:03:06 +00:00 |
|
|
Nick CaoandCodex
|
d521b3f917
|
[Misc] remove legacy full_duplex alias for auto_response (#8024)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-23 06:09:19 -07:00 |
|
|
Yuan WuandHongsheng Liu
|
cb5f508212
|
[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-23 18:26:53 +08:00 |
|
|
Sy03
|
5634f03eb1
|
[Bugfix] Restore MRV2 full-payload transport for offline Qwen3-TTS (#8010)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-23 01:51:20 +00:00 |
|
|
Yueqian Lin
|
3f473a358b
|
[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)
|
2026-09-22 17:10:15 -07:00 |
|
|
MaciejBalaNV
|
c482626450
|
[optimization] Added Wan 2.2 VAE decode optimizations (#7056)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
|
2026-09-22 11:37:49 -07:00 |
|
|
|
59db6a4285
|
[Rebase] Rebase to vLLM 0.30.0 (#7820)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-22 15:52:01 +00:00 |
|
|
yanbao1217andyanbao1217
|
ca14e635f5
|
[Doc] Correct the SessionClosed admission-slot guarantee (#7636 Issue 22) (#7869)
Signed-off-by: yanbao1217 <yanliuwebsite493@gmail.com>
Co-authored-by: yanbao1217 <yanliuwebsite493@gmail.com>
|
2026-09-22 14:57:50 +00:00 |
|
|
ZacheryAUandamy-why-3459
|
0582844a41
|
[Frontend][Benchmark] Add duplex performance metrics to refactored full-duplex framework (#7714)
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-22 03:04:22 -07:00 |
|
|
Tianyao Wu
|
ba5b7485a7
|
[Bugfix] Keep resumable duplex prompts out of async-chunk prewarm (#7992)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
|
2026-09-22 15:36:42 +08:00 |
|
|
|
085cf0ff34
|
[Bugfix] Catch asyncio.TimeoutError so duplex serving starts on Python 3.10 (#7412)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-09-21 18:34:58 -07:00 |
|
|
Nick CaoandCodex
|
1d3dc8bf83
|
[Misc] Refactor static stage metadata lookups (#7602)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-21 18:34:50 -07:00 |
|
|
Sy03
|
473da2cf82
|
[Perf][Qwen3-TTS] Enable event-driven orchestration by default (#7088)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 12:09:19 -07:00 |
|
|
vOv
|
d8d162d810
|
[Core][Diffusion] Add pause_generation(mode="keep") for diffusion stages (#7685)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
|
2026-09-22 01:31:22 +08:00 |
|
|
NumberWan
|
62b15142bd
|
[Model] Integrate AURA into Full-Duplex Runtime (#7633)
|
2026-09-21 09:26:54 -07:00 |
|
|
shiyichuanandmershi
|
fb2e3535af
|
[Bugfix][Engine] Preserve text_encoder_tp_size in OmniEngineArgs (#7652)
Signed-off-by: mershi <mershi@tencent.com>
Co-authored-by: mershi <mershi@tencent.com>
|
2026-09-21 17:01:03 +08:00 |
|
|
Sy03
|
a9e2117f5e
|
[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-20 23:03:08 -07:00 |
|
|
|
102ba716bf
|
[Feat] Add native Mooncake KV transfer from AR to DiT (#7166)
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-20 14:44:55 +00:00 |
|
|
psv666
|
2d0b03f717
|
[Bugfix] Fix Qwen3-Omni realtime playback interruption and conversation history (#7791)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-20 14:42:17 +00:00 |
|
|
leegangtoe
|
fa506e0fe8
|
[Bugfix] Register statistics for dynamically added replicas (#7298)
Signed-off-by: leegangtoe <leegangtoe@gmail.com>
|
2026-09-19 17:07:14 +00:00 |
|
|
akshatvishu
|
415005be22
|
[Model] Add circlestone-labs/Anima (#4083)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
|
2026-09-19 16:16:38 +00:00 |
|
|
|
698f716012
|
[Refactor] Reject unknown diffusion config fields (#5172)
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Signed-off-by: zuiho <2324465096@qq.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-19 15:37:34 +00:00 |
|
|
bcsdhjew
|
fbb4e63f0a
|
[Bugfix][Core] Apply Realtime item truncation once per command (#7800)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
|
2026-09-18 18:59:09 +00:00 |
|
|
amy-why-3459
|
882bf8bc95
|
[Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-17 23:32:31 +08:00 |
|
|
Tiago de Souza Fernandes
|
5b22f5562f
|
fix(minicpmo45): deadline-align native duplex silence continuation (#7059)
Signed-off-by: Tiagosf00 <tiagotsf2000@gmail.com>
|
2026-09-17 05:26:34 -07:00 |
|
|
psv666
|
e3be42e052
|
[Core] Give the OpenAI Realtime wire codec a reusable home (RFC #6592 P0a) (#7640)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-17 02:33:40 -07:00 |
|
|
Sy03
|
4200768f59
|
[Frontend] Scale Omni serving across API processes (#6923)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-16 22:29:31 -07:00 |
|
|
maithilijoshi20
|
f1a6e7ce2a
|
[Core] Retain structured configs through runtime startup (#6849)
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
|
2026-09-16 20:47:38 -07:00 |
|
|
Aman
|
c32aaeb2da
|
[Bugfix] Fix Qwen3-TTS word timestamps with async chunking (#7544)
Signed-off-by: bezdarnost <amanurumbekov@gmail.com>
|
2026-09-16 15:07:52 -07:00 |
|
|
|
fa639b889e
|
[Bugfix] Fail a duplex session that outgrows max_model_len instead of killing the EngineCore (#7277)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-16 20:08:25 +08:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
Zheng Wengangandwuli666
|
275720b378
|
[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
|
2026-09-15 20:43:30 -07:00 |
|
|
|
ea1a416a17
|
[Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084)
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-14 09:55:53 -07:00 |
|
|
Yuan Wu
|
6753bbd18c
|
[Core] Add NIXL omni connector (#6093)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Signed-off-by: Yuan Wu <yuan.wu@intel.com>
|
2026-09-13 16:35:02 +08:00 |
|
|
Samit
|
96360ccb00
|
[Perf][Diffusion] Optimize HSDP startup via Rank-0 shared weight loading and accelerated LoRA delta computation (#7005)
Signed-off-by: samithuang <285365963@qq.com>
|
2026-09-11 08:28:42 +00:00 |
|
|
|
a2486dd00b
|
[Core][Diffusion] Add a typed pre-D2H video media contract (#6615)
Signed-off-by: NancyFyong <NancyFyong@users.noreply.github.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: NancyFyong <NancyFyong@users.noreply.github.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-09-10 09:50:54 +00:00 |
|
|
Zhou TaichangandClaude Opus 5
|
aff7d64948
|
[Rebase] Rebase to vLLM 0.29.0 (#7230)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-10 12:08:28 +08:00 |
|
|
Gao Hanandamy-why-3459
|
6e63ea875e
|
[Bugfix] Allow LLM replicas on different GPUs to initialize concurrently (#7292)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-10 09:54:20 +08:00 |
|
|
kunkun
|
2f1845fa4e
|
fix: reserve Qwen3-Omni NVFP4 backend fix (#7200)
Signed-off-by: kunkunblueberry <1833921874@qq.com>
|
2026-09-09 20:35:16 +08:00 |
|
|
Zheng Wengangandamy-why-3459
|
7c1b1e4189
|
[Bugfix][Engine] Group overlapping device stages into one sequential init component (#7328)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-09 20:25:41 +08:00 |
|
|
|
fdaf4e31bd
|
Add vLLM-Omni library info to Hugging Face Hub requests (#5381)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-08 10:08:38 -06:00 |
|
|
Honghan Zhuandamy-why-3459
|
d59d166485
|
[Bugfix] Preserve additional_config for LLM stages (#7272)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-08 20:44:49 +08:00 |
|
|
Shuolei Wang
|
5378b77be4
|
[Model][JoyAI-VL-Interaction] Add native multi-stage pipeline (#5352)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
|
2026-09-08 05:07:08 -07:00 |
|
|
LHXuuu
|
c9c25b33c3
|
[Frontend] Add server-side VAD for turn-based omni models (#6618)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
|
2026-09-08 03:17:00 -07:00 |
|