 Sy03
|
dd765fbf64
|
[Model] Select CosyVoice3 streaming defaults by device capability (#8433)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-03 21:59:36 -07:00 |
|
|
Sy03andYueqian Lin
|
3bc3f1a7d0
|
[Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-02 18:03:14 +00:00 |
|
|
Sy03
|
2ba5074ca0
|
[Model] Optimize CosyVoice3 packed streaming with bounded HiFT graphs (#8420)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 08:49:50 -07:00 |
|
|
Yueqian Lin
|
4025bb30f6
|
[Perf][AuK] Graph the encoder prefill, cache reference latents and fuse the codec activation (#8305)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-02 15:43:55 +00:00 |
|
|
|
ae58c2d8b9
|
[Model] YuE2: async single-stage synthesis and CUDA graph acceleration (#8407)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Wang Zhipeng <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 05:17:06 -07:00 |
|
|
Sy03
|
e84014dffb
|
[Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 21:34:30 +10:00 |
|
|
Sy03
|
d93e1a8e09
|
[Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-01 22:22:54 -07:00 |
|
|
Youyuan Liandprincepride
|
423f34326e
|
[Model] Add YuE2-3B text-to-music (model + /v1/audio/speech adapter) (#7886)
Signed-off-by: Youyuan Li <105433145+Darcy-Lee@users.noreply.github.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-10-01 18:04:31 +08:00 |
|
|
Sy03
|
56763cd6c3
|
[Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-30 11:32:27 +00:00 |
|
|
Egor Chernobrovkin
|
c27a52a359
|
[Model] Make VoxCPM2 generation settings configurable (#7010)
Signed-off-by: Egor Chernobrovkin <33jasooon33@gmail.com>
|
2026-09-30 11:26:12 +08:00 |
|
|
Yueqian Lin
|
146ccc133a
|
[Perf][AuK] Compile the DiT step, use cuDNN attention and warm up at startup (#8300)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-30 11:21:21 +08:00 |
|
|
|
35cf6ac355
|
[Feat][Perf][AuK]Support Online Serving and DiT CUDAGraph (#7469)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-30 00:18:38 +00:00 |
|
|
BruceLoveDecimalandYueqian Lin
|
3a28882946
|
[Perf][Auk] VAE cuda graph and tiling (#7881)
Signed-off-by: liuqihao <liuqihao970610@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-29 23:27:01 +00:00 |
|
|
Sy03
|
5af3a16526
|
[Model] Add MiniCPM-o 4.5 turn-mode MRv2 and batched audio inference (#8222)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 11:41:39 -07:00 |
|
|
Sy03andzack
|
1ea0ee3b38
|
[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: zack <huixindaddy@yahoo.com>
Co-authored-by: zack <huixindaddy@yahoo.com>
|
2026-09-29 15:48:36 +00:00 |
|
|
Canlin Guo
|
235c430326
|
[Frontend] Tune reference cache limits and registered MOSS voice requests (#7883)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-09-29 04:10:17 +00:00 |
|
|
Wallbreazzz
|
5b3abe2f4d
|
[Feature][TTS] Port static chunk ramp to Moss-TTS streaming codec decode (#8124)
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
|
2026-09-29 02:28:15 +00:00 |
|
|
BeatSeat
|
3e62bba3cb
|
[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)
|
2026-09-29 09:14:12 +10:00 |
|
|
Yueqian Lin
|
f5bdb20e9d
|
[Perf][PersonaPlex] Serve 16 concurrent realtime duplex sessions on one GPU (#8192)
|
2026-09-28 04:51:38 +00:00 |
|
|
Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
|
29dacbd3ef
|
[Bugfix][MammothModa2] Keep AR layer 0 in BF16 in the FP8 KV preset (#8083)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: zijianc2 <157244773+zijianc2@users.noreply.github.com>
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-25 21:25:49 +08:00 |
|
|
BeatSeatandamy-why-3459
|
b308e196c9
|
[Model] Support request-level batching for MammothModa2 DiT on shared runtime (#7476)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-25 10:34:59 +08:00 |
|
|
|
f46c958b67
|
[Bugfix][Qwen3-Omni] Restore the talker sampling seed (#7474)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-09-24 17:41:03 -07:00 |
|
|
NumberWan
|
7650020618
|
[BugFix][Cosmos3] Register opt-in T2I pipeline so deploy-config applies (#7971)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-09-24 10:08:46 +00:00 |
|
|
Joshna-Medisetty
|
5e6b9047c9
|
[Bugfix] Drain the omni connector output on the main thread in the AR runner (#7750)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
|
2026-09-23 11:36:56 -07:00 |
|
|
Yuanheng Zhao
|
71125f80ad
|
[New Model] Ming-Image (inclusionAI/Ming-Image-0.1-Design) Support (#8021)
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com>
|
2026-09-23 12:20:06 +00:00 |
|
|
Yuan WuandHongsheng Liu
|
cb5f508212
|
[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-23 18:26:53 +08:00 |
|
|
Yueqian Lin
|
3f473a358b
|
[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)
|
2026-09-22 17:10:15 -07:00 |
|
|
shihongzhi
|
c11596c637
|
[Model] MammothModa2: enable Cache-DiT acceleration for the DiT stage (#7291)
Signed-off-by: shihongzhi <shi65881583@gmail.com>
|
2026-09-21 18:34:12 -07:00 |
|
|
jingchengtian
|
0b5f8832b9
|
[tts][feature][NPU] Add 2-NPU and 3-NPU disaggregated deploy profiles for MOSS-TTS-Local (#7052)
Signed-off-by: jingchengtian <tjc1995@126.com>
|
2026-09-21 23:14:52 +00:00 |
|
|
Sy03
|
60a933b9ab
|
[Model] Default Qwen3-TTS to experimental Model Runner V2 (#7930)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 18:56:06 +00:00 |
|
|
NumberWan
|
62b15142bd
|
[Model] Integrate AURA into Full-Duplex Runtime (#7633)
|
2026-09-21 09:26:54 -07:00 |
|
|
Zhou TaichangandClaude Fable 5.1
|
5356357cf0
|
[LingBot World] Shard the streaming VAE decode across the Ulysses ranks (#7651)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 19:00:46 +08:00 |
|
|
Sy03
|
a9e2117f5e
|
[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-20 23:03:08 -07:00 |
|
|
|
ae3880f0e3
|
[Performance] Capture MOSS-TTS codec streaming decode with NPUGraph (#7280)
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-21 06:38:23 +08:00 |
|
|
|
102ba716bf
|
[Feat] Add native Mooncake KV transfer from AR to DiT (#7166)
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-20 14:44:55 +00:00 |
|
|
amy-why-3459
|
9f5521351e
|
[Benchmark][MiniCPM-o] Port Video-MME dataset support to Omni bench s… (#6987)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-20 17:15:53 +08:00 |
|
|
wangyuandYueqian Lin
|
6a03e45c34
|
[Misc] Remove Dynin-Omni and dots.tts support (#7655)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-20 00:28:29 -07:00 |
|
|
|
470ec60848
|
[Core] Refactor omni prefix cache into Manager/Controller (#6654)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-19 21:23:59 +08:00 |
|
|
|
7b4fc7ce2e
|
[Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134)
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-18 13:29:18 -07:00 |
|
|
akshatvishu
|
3084b5d107
|
[BugFix][TTS] Restore MOSS v1 codec streaming (#6420)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
|
2026-09-18 20:06:57 +08:00 |
|
|
Joshna-Medisetty
|
77d8de70da
|
[XPU][HunyuanImage3] Fix HunyuanImage-3.0 text-to-image on XPU (#7674)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
|
2026-09-17 19:23:27 +00:00 |
|
|
Nick CaoandCodex
|
b81f2c5d4b
|
[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-17 19:22:14 +00:00 |
|
|
amy-why-3459
|
882bf8bc95
|
[Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-17 23:32:31 +08:00 |
|
|
Chenchao Xu
|
d0755b5716
|
[Model] Add π0.5 (Pi0.5) VLA model support (#6950)
Signed-off-by: chenchaox <chenchaox@nvidia.com>
|
2026-09-17 05:18:51 -07:00 |
|
|
Sy03
|
4200768f59
|
[Frontend] Scale Omni serving across API processes (#6923)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-16 22:29:31 -07:00 |
|
|
Linze Shi
|
c8b3a17bd3
|
[Frontend] Allow explicit turn-based serving (#7675)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-09-16 17:29:57 -07:00 |
|
|
Yueqian Lin
|
5aadcbb0ab
|
[Bugfix] Fix Breeze-TTS-2 repeated silence and audio EOS handling
|
2026-09-16 18:40:12 +00:00 |
|
|
Lei Ke
|
38c7eeee4c
|
[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546)
Signed-off-by: Lei Ke <1141466880@qq.com>
|
2026-09-16 11:38:06 -07:00 |
|
|
THUqliu
|
d4dba0ddb1
|
[Misc] Remove dead deploy keys from personaplex.yaml (#7454)
Signed-off-by: THUqliu <3298452736@qq.com>
|
2026-09-16 13:13:32 -04:00 |
|