Zhou Taichang
5a7cda40c3
Merge branch 'main' into fix/omni-weight-snapshot-prefetch
2026-06-12 14:54:29 +08:00
Ting FU
1be1a71156
[Model] Add more resolution support for HunyuanImage3.0 ( #4004 )
...
Signed-off-by: Semmer <semmer@live.cn >
2026-06-12 14:44:00 +08:00
yangyonggit
a3834e32cf
feat(moss-tts): add CUDA Graph support for codec decoder ( #4157 )
...
Signed-off-by: leo.yang <leo.yang.engineer@gmail.com >
2026-06-11 22:17:31 +00:00
e27fd46ab9
[Perf] Optimize Higgs Audio v3 serving ( #4204 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-11 13:29:31 -07:00
tanhaoan333
e26f5cb918
[NPU] Support VoxCPM2 model ( #4310 )
...
Signed-off-by: tanhaoan333 <tanhaoan@huawei.com >
2026-06-11 14:12:06 +08:00
ChenWenjing and Sy03
1fe267d6c9
[Bugfix][VoxCPM2] Fix VoxCPM2 concurrent speech quality ( #4319 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Sy03 <1370724210@qq.com >
2026-06-11 11:12:07 +08:00
dengyunyang and Hongsheng Liu
14879d6619
[Bugfix][HunyuanImage] fix accuracy in stream mode ( #4265 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-11 10:39:00 +08:00
Guanzhe (Leo) Huang
c2b4564a67
[BugFix] moss_tts_nano: eager-init lm + audio_tokenizer in __init__ so load_format: dummy works ( #3230 )
...
Signed-off-by: leohuang257 <masugchds@gmail.com >
2026-06-10 20:50:53 +08:00
akshatvishu and Hongsheng Liu
2fa4c7a4a9
[Model] Add Ming-omni-tts dense 0.5B pipeline ( #2906 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-10 20:11:04 +08:00
Yuekai Zhang and Claude Opus 4.8
f1bf544208
[Perf][TTS] Optimize cosyvoice TTFP and throughput using TensorRT ( #4168 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-10 16:42:34 +08:00
57227dc7f3
[Perf][Bugfix] qwen3-tts hot path: prefix-cache OOM guards + talker/orchestrator micro-opts ( #3689 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-09 10:36:57 -07:00
Sy03
9c9d4ed4a8
[Fix][HiggsAudioV3] Fix ramp-down off-by-one crash and buffer state bugs in Stage0 talker ( #4219 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-06-08 17:33:20 +00:00
amy-why-3459
fc7393e485
[Refactor]Refactoring audio_in_video implementation ( #3566 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-08 14:14:02 +08:00
eb1b782dd1
[BugFix] fix hunyuan image3 offline cot ( #4174 )
...
Signed-off-by: zzh <943967662@qq.com >
Signed-off-by: zengchuang <zengchuang3@huawei.com >
Co-authored-by: zengchuang <zengchuang3@huawei.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-06-08 10:58:44 +08:00
SYLAR
29b18ea298
[Quant] ModelOpt FP8 for Wan2.2 & HunyuanVideo-1.5 video-gen ( #3305 )
...
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
2026-06-08 02:53:06 +08:00
Yueqian Lin
fce0f51089
[Perf][Higgs-Audio-V3] LRU cache for voice-clone ref-audio encode ( #4200 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-07 03:09:16 +00:00
Yuekai Zhang and Yueqian Lin
82e74ce972
[TTS][New Model] support bosonai/higgs-audio-v3-tts-4b ( #4169 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-06 15:59:12 +00:00
Yaegaki1Erika and reandeng
84569280b1
[Bugfix]Fix HunyuanImage3 conditional image and prompt kwargs alignment ( #4145 )
...
Signed-off-by: reandeng <reandeng@tencent.com >
Signed-off-by: Yaegaki1Erika <70182590+Yaegaki1Erika@users.noreply.github.com >
Co-authored-by: reandeng <reandeng@tencent.com >
2026-06-05 12:47:25 +08:00
Yuanheng Zhao and akshatvishu
95d56cf062
[Bugfix] Fix Compatibility of Ming-flash-omni-2.0 on transformers 5.X and vllm 0.22 ( #4080 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
Co-authored-by: akshatvishu <akshatnayak197@gmail.com >
2026-06-05 09:27:42 +08:00
Gao Han
49c102589b
Merge branch 'main' into fix/omni-weight-snapshot-prefetch
2026-06-04 22:59:51 +08:00
ZacheryAU
bfc7cedcf1
Benchmark data statistics for each stage of omni models ( #3628 )
...
Signed-off-by: ZacheryAU <70869627+ZacheryAU@users.noreply.github.com >
2026-06-04 21:43:35 +08:00
Yuekai Zhang
a1cc583665
fix: cosyvoice3 batch>1 inference ( #3910 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
2026-06-04 08:58:53 +00:00
tzhouam and Cursor
930c317b2b
fix: harden omni weight snapshot downloads
...
Serialize full-repo Hugging Face snapshot materialization with a repo-wide
node lock and retry incomplete snapshots so CI does not race on shared caches.
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-04 07:54:12 +00:00
amy-why-3459
4e1c13236e
[Perf][Qwen3-Omni]Optimize TTFP using initial_codec_chunk_frames ( #4054 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-04 09:08:13 +08:00
c33ca60208
[Perf][VoxCPM2] Optimize VoxCPM2 high-concurrency decode throughput. ( #3882 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-03 23:08:32 +08:00
Canlin Guo
ce69eb35e9
[Refactor] Refactor HunyuanImage3 SigLIP2 ViT to vLLM layers ( #3297 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-06-03 17:51:06 +08:00
Honghan Zhu and Claude Opus 4.8
3329f1b674
[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… ( #4078 )
...
Signed-off-by: dph97 <nenbaying@163.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-02 21:28:12 +00:00
bdfc77147d
[Diffusion] DreamZero world model integration with CFG parallel + OpenPI serving ( #2162 )
...
Signed-off-by: Meng <meng_chen99@163.com >
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Signed-off-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: Meng <meng_chen99@163.com >
Co-authored-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-02 19:50:20 +00:00
Zhang Jian and Canlin Guo
b550709bba
[TTS][Model] support MOSS-TTS series ( #3420 )
...
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Signed-off-by: jian <jianmusings@gmail.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Canlin Guo <961750412@qq.com >
2026-06-02 15:46:01 +08:00
NATURE
1fb423e5f6
[Perf][Bagel] Avoid per-step device syncs in Bagel img2img ( #3987 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-06-02 10:58:32 +08:00
2b7249fbb3
[Model]Support MiniCPM-o 4.5 ( #3642 )
...
Signed-off-by: tc-mb <tianchi_cai@icloud.com >
Co-authored-by: GKangaroo <1095103651@qq.com >
Co-authored-by: GKangaroo <gqx24@mails.tsinghua.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-01 22:12:24 +08:00
b76291d6a1
[New Model] Add Lance (ByteDance) ( #3710 )
...
Signed-off-by: lishunyang <lishunyang03@gmail.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
Co-authored-by: lishunyang <lishunyang03@gmail.com >
Co-authored-by: Haco <923390377@qq.com >
2026-06-01 16:01:25 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
d4c139508f
[Feature] Add precomputed custom voices and Qwen3-TTS ref-context cache ( #3492 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Dan250124 <416947747@qq.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-31 17:51:24 +00:00
Qing An and Samit
57e5f0fe69
[model, omni] feat: Qwen3-Omni Thinker LoRA for RL training ( #3915 )
...
Signed-off-by: Qing An <qa4@rice.edu >
Co-authored-by: Samit <285365963@qq.com >
2026-06-01 00:10:14 +08:00
ChenWenjing
5dfdf584dd
[Feat]audio streaming input for async chunk ( #3614 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-05-31 17:39:25 +08:00
Yuanheng Zhao and Zheng Wengang
ea6d811b58
[Config Refactor] Migrate Ming-flash-omni-2.0 Image-Gen deploy configs ( #3975 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
2026-05-30 08:13:21 +00:00
Viacheslav Klimkov and Yueqian Lin
914e92cf80
[Refactor][Qwen3-TTS] Extract reusable prompt-embeds builder and make tts_pad_embed a persistent buffer ( #3992 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-30 16:11:00 +08:00
nperraud
9fdb3bcb89
[Bugfix][Model] Qwen3-TTS: don't collapse 2D ref_code list when estimating prompt length ( #3940 )
...
Signed-off-by: nperraud <nathanael.perraudin@gmail.com >
2026-05-29 09:18:25 -06:00
amy-why-3459 and Hongsheng Liu
2696751003
[Perf] Qwen3-Omni performance optimization ( #3878 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-29 22:15:23 +08:00
boatman and sphinxkkkbc
4d9262a6eb
[Feat]Support voice clone for omnivoice in online serving & add seed parameter for reproducible ( #3668 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-29 07:42:08 +00:00
amy-why-3459
5dd1d0a772
[BugFix] Fix prefix-caching issue ( #3726 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-29 01:51:54 +00:00
Dakai An
bb9f21d0db
Fix Qwen3-omni accuracy degradation from deepstack inputs under torch.compile ( #3885 )
...
Signed-off-by: Dakai An <dakaian108@gmail.com >
2026-05-28 23:57:56 +08:00
Nick Cao and Claude
c20afebce4
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively ( #3360 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-28 16:20:49 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
0f3264a9c0
[Perf][Bugfix] cache hot buffers in qwen3_tts talker; fall back on evicted state ( #3688 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-28 05:45:54 +00:00
BeatSeat
dab596e468
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules ( #3886 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
2026-05-27 23:41:35 -05:00
Sy03 and Yueqian Lin
d37912b071
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving ( #3773 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-27 13:25:49 -05:00
a698269e47
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage ( #2875 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-05-27 23:21:20 +08:00
Dan
1f1c82ecdd
[BugFix] Fix Qwen3-TTS Code2Wav compatibility with transformers >= 5.9.0 ( #3880 )
...
Signed-off-by: Dan250124 <416947747@qq.com >
2026-05-26 16:24:43 +00:00
Zhou Taichang