 amy-why-3459
|
de253412b0
|
[Core] Defer generation payload host waits to output consumption (#8540)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-07 17:20:54 +08:00 |
|
|
amy-why-3459
|
9482bf1e8c
|
[Model] MiniCPM-o 4.5: enable fused CFM body by default on CUDA (#8557)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-07 10:25:39 +08:00 |
|
|
|
712b90de9c
|
[Perf][Qwen3-Omni] Capture the thinker image encoder with CUDA graphs (part of #7452) (#8215)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: zijianc2 <157244773+zijianc2@users.noreply.github.com>
Co-authored-by: Yifan Tian <221685243+Sendoh-code@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-07 09:29:59 +08:00 |
|
|
Yueqian Lin
|
ed6bc5ae0c
|
[Perf][PersonaPlex] Batch live duplex appends and replay Mimi codec frames from CUDA graphs (#8356)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-07 00:05:08 +00:00 |
|
|
Sy03
|
7be49aa0ce
|
[Model] Default MOSS Local 1.5 to adaptive CUDA MRV2 with MPS (#8438)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-06 08:20:46 -07:00 |
|
|
BeatSeatandamy-why-3459
|
182b77da4c
|
[Perf][MiniCPM-o] Stage 0 streaming audio/vision encoder CUDA graphs and candidate sampling (#8430)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-06 07:53:03 -07:00 |
|
|
|
25fb257667
|
[Model] MiniMax-H3: accept raw video masks and resolve the latent grid server-side (#7947)
Signed-off-by: chen hongwei <1792043268@qq.com>
Signed-off-by: Wang Zhipeng <wangzhipeng628@gmail.com>
Co-authored-by: Wang Zhipeng <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 12:46:35 +00:00 |
|
|
Tianyao Wuandamy-why-3459
|
cc444b8875
|
[Bugfix][MiniCPM-o] Take the duplex vision tile from the image-processor config (#8462)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-06 09:04:21 +08:00 |
|
|
Linze Shi
|
aad3090877
|
[Model][PersonaPlex] Vectorize prefill embedding construction (#7481)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-10-05 18:52:41 +00:00 |
|
|
LOGO127
|
ae430dddc0
|
[Model][PersonaPlex] Encode only consumed Mimi codebooks (#7399)
Signed-off-by: luozijian <luozijian0924@gmail.com>
|
2026-10-05 18:49:33 +00:00 |
|
|
BeatSeatandamy-why-3459
|
79562e97ad
|
[Perf][MiniCPM-o] Code2Wav resident Euler slot pool, fused DiT body, and exact HiFT graphs (#8443)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-05 18:36:28 +00:00 |
|
|
amy-why-3459
|
9146284c16
|
[Perf] Add CUDA graphs for MiniCPM-o 4.5 input encoders (#8332)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-05 15:01:07 +00:00 |
|
|
|
5351cd6645
|
[Bugfix] Qwen3-Omni thinker: create deepstack buffers on the real device (#8461)
Signed-off-by: John Nunez <johnnynunez@users.noreply.github.com>
Co-authored-by: John Nunez <johnnynunez@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-05 21:00:04 +08:00 |
|
|
ztyan
|
091b256674
|
[Model][Perf] IndexTTS2: drop per-step hidden D2H in latent mode (#8478)
Signed-off-by: ztyan <191593482+vivivi-111@users.noreply.github.com>
|
2026-10-05 20:20:25 +08:00 |
|
|
JungleandCodex
|
67d21b5fff
|
[Core] Add token_ids output type and enforce canonical names (#7843)
Signed-off-by: Jungle430 <junglece430@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-05 16:49:03 +08:00 |
|
|
Zhou Taichang
|
0b0d2d7009
|
[Rebase] Align vLLM-Omni with vLLM v0.31.0 (#8459)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-10-05 14:11:01 +08:00 |
|
|
Scott Ye
|
1f47fa2f29
|
[Model][Core] Avoid unused CosyVoice3 payloads and redundant AR output work (#8473)
Signed-off-by: Sorbett <sorbet111@163.com>
|
2026-10-05 04:52:19 +00:00 |
|
|
bcsdhjew
|
f781f7bb08
|
[Core][Frontend] Bound duplex output delivery and reject cancelled audio (#7644)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
Signed-off-by: bcsdhjew <nliang@nvidia.com>
|
2026-10-04 14:06:04 -07:00 |
|
|
hurukawa
|
c9c478dd07
|
[Perf] Support TeaCache for MammothModa2 (#5357)
Signed-off-by: nagisa-kun <1434936049@qq.com>
Signed-off-by: nagisa <1434936049@qq.com>
|
2026-10-05 01:25:56 +08:00 |
|
|
andyluo7
|
3ab726c126
|
test: bound CPU vocoder reference threads (#8347)
Signed-off-by: andyluo7 <andy.luo@amd.com>
|
2026-10-04 19:19:22 +13:00 |
|
|
Sy03
|
1c1b831f58
|
[Model] Batch Qwen3-TTS Talker prompt projection and settled-row preprocessing (#8477)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-04 05:08:24 +00:00 |
|
|
andyluo7
|
b171731c81
|
fix: preserve CosyVoice full payload and live conditioning (#8343)
Signed-off-by: andyluo7 <andy.luo@amd.com>
|
2026-10-04 16:03:27 +13:00 |
|
|
andyluo7
|
09d704907f
|
fix: preserve Torch seeded sampling on ROCm (#8341)
Signed-off-by: andyluo7 <andy.luo@amd.com>
|
2026-10-04 16:03:21 +13:00 |
|
|
andyluo7
|
ee8fdab1dc
|
[CI/Build] Fix MOSS CPU tests on ROCm workers (#8447)
Signed-off-by: andyluo7 <andy.luo@amd.com>
|
2026-10-03 09:13:51 +08:00 |
|
|
Sy03andYueqian Lin
|
3bc3f1a7d0
|
[Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-02 18:03:14 +00:00 |
|
|
Sy03
|
2ba5074ca0
|
[Model] Optimize CosyVoice3 packed streaming with bounded HiFT graphs (#8420)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 08:49:50 -07:00 |
|
|
Nick CaoandCodex
|
0e6791e9c4
|
[Bugfix] Initialize eager state in Higgs test fixture (#8426)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-02 10:22:52 -04:00 |
|
|
Sy03
|
e372aa3a41
|
[Bugfix] Restore Fish Speech and CosyVoice3 audio quality at high concurrency (#8422)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 07:11:04 -07:00 |
|
|
Sy03
|
e84014dffb
|
[Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 21:34:30 +10:00 |
|
|
Sy03
|
d93e1a8e09
|
[Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-01 22:22:54 -07:00 |
|
|
andyluo7
|
bbee488da3
|
fix: repair ROCm test routing, CPU timeouts, and Breeze autotuning (#8342)
Signed-off-by: andyluo7 <andy.luo@amd.com>
|
2026-10-02 07:36:41 +08:00 |
|
|
amy-why-3459
|
4af28f33bd
|
[Bugfix] Defer VoxCPM2 NPU patch to avoid platform import cycle (#8330)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-30 05:25:36 -07:00 |
|
|
Sy03
|
56763cd6c3
|
[Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-30 11:32:27 +00:00 |
|
|
|
aa41a3ac97
|
[Bugfix] Fix the remaining Python 3.10 breakages (#7985)
Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-30 11:38:23 +08:00 |
|
|
Egor Chernobrovkin
|
c27a52a359
|
[Model] Make VoxCPM2 generation settings configurable (#7010)
Signed-off-by: Egor Chernobrovkin <33jasooon33@gmail.com>
|
2026-09-30 11:26:12 +08:00 |
|
|
yulunandHongsheng Liu
|
9097fa6547
|
[Hardware][Ascend] Accelerate VoxCPM2 LocDiT with NPUGraph (#7275)
Signed-off-by: Big2Wheel <1404207590@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-30 10:11:22 +08:00 |
|
|
Sy03
|
5af3a16526
|
[Model] Add MiniCPM-o 4.5 turn-mode MRv2 and batched audio inference (#8222)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 11:41:39 -07:00 |
|
|
jingchengtianandjingchengtian
|
43ef1e61fb
|
[Perf][TTS] Add per-row generator support to MOSS-TTS talker to eliminate serial fallback for seeded batched requests (#7922)
Signed-off-by: jingchengtian <jingchengtian@users.noreply.github.com>
Signed-off-by: jingchengtian <tjc1995@126.com>
Co-authored-by: jingchengtian <jingchengtian@users.noreply.github.com>
|
2026-09-29 13:13:50 -04:00 |
|
|
Sy03andzack
|
1ea0ee3b38
|
[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: zack <huixindaddy@yahoo.com>
Co-authored-by: zack <huixindaddy@yahoo.com>
|
2026-09-29 15:48:36 +00:00 |
|
|
Wallbreazzz
|
5b3abe2f4d
|
[Feature][TTS] Port static chunk ramp to Moss-TTS streaming codec decode (#8124)
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
|
2026-09-29 02:28:15 +00:00 |
|
|
BeatSeat
|
3e62bba3cb
|
[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)
|
2026-09-29 09:14:12 +10:00 |
|
|
|
7266fc6138
|
[Bugfix] Avoid enlarging MiniMax H3 reference images and videos (#8253)
Signed-off-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-09-28 20:12:53 +00:00 |
|
|
BeatSeatandHongsheng Liu
|
2a453c5ad8
|
feat(cosyvoice3): GPU-resident F0 predictor & pure-PyTorch vocoder (Task C2) (#7518)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-28 23:13:43 +08:00 |
|
|
chickeytonandClaude Opus 5.5
|
5ce6f5dc49
|
[Bugfix][MiniCPM-o] Forward a speech unit closed by LISTEN after turn_eos to the Talker (#8227)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-28 11:11:42 +00:00 |
|
|
Yueqian Lin
|
f5bdb20e9d
|
[Perf][PersonaPlex] Serve 16 concurrent realtime duplex sessions on one GPU (#8192)
|
2026-09-28 04:51:38 +00:00 |
|
|
BeatSeatandamy-why-3459
|
c8a1419e02
|
[Performance][MiniCPM-o] Zero-copy block-aligned KV sliding window with in-place Re-RoPE for duplex Stage-0 (#7821)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-28 10:11:54 +08:00 |
|
|
|
798d52ce55
|
[Core][Model] Fit PersonaPlex into the Unified Full-duplex Framework (RFC #7181 PR 2) (#7695)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-27 03:02:24 +00:00 |
|
|
Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Sy03
|
d31a2a3ba8
|
[Bugfix] Fix Nemotron VoiceChat duplex nightly handshake (#7884)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-25 17:25:15 +00:00 |
|
|
chickeytonandClaude Opus 5.5
|
4be6bbe0e4
|
[Bugfix][MiniCPM-o] Build the Stage-0 duplex runtime at load time (#8146)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-25 14:57:23 +00:00 |
|