tzhouam and Cursor
930c317b2b
fix: harden omni weight snapshot downloads
...
Serialize full-repo Hugging Face snapshot materialization with a repo-wide
node lock and retry incomplete snapshots so CI does not race on shared caches.
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-04 07:54:12 +00:00
amy-why-3459
4e1c13236e
[Perf][Qwen3-Omni]Optimize TTFP using initial_codec_chunk_frames ( #4054 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-04 09:08:13 +08:00
c33ca60208
[Perf][VoxCPM2] Optimize VoxCPM2 high-concurrency decode throughput. ( #3882 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-03 23:08:32 +08:00
Canlin Guo
ce69eb35e9
[Refactor] Refactor HunyuanImage3 SigLIP2 ViT to vLLM layers ( #3297 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-06-03 17:51:06 +08:00
Honghan Zhu and Claude Opus 4.8
3329f1b674
[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… ( #4078 )
...
Signed-off-by: dph97 <nenbaying@163.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-02 21:28:12 +00:00
bdfc77147d
[Diffusion] DreamZero world model integration with CFG parallel + OpenPI serving ( #2162 )
...
Signed-off-by: Meng <meng_chen99@163.com >
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Signed-off-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: Meng <meng_chen99@163.com >
Co-authored-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-02 19:50:20 +00:00
Zhang Jian and Canlin Guo
b550709bba
[TTS][Model] support MOSS-TTS series ( #3420 )
...
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Signed-off-by: jian <jianmusings@gmail.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Canlin Guo <961750412@qq.com >
2026-06-02 15:46:01 +08:00
NATURE
1fb423e5f6
[Perf][Bagel] Avoid per-step device syncs in Bagel img2img ( #3987 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-06-02 10:58:32 +08:00
2b7249fbb3
[Model]Support MiniCPM-o 4.5 ( #3642 )
...
Signed-off-by: tc-mb <tianchi_cai@icloud.com >
Co-authored-by: GKangaroo <1095103651@qq.com >
Co-authored-by: GKangaroo <gqx24@mails.tsinghua.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-01 22:12:24 +08:00
b76291d6a1
[New Model] Add Lance (ByteDance) ( #3710 )
...
Signed-off-by: lishunyang <lishunyang03@gmail.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
Co-authored-by: lishunyang <lishunyang03@gmail.com >
Co-authored-by: Haco <923390377@qq.com >
2026-06-01 16:01:25 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
d4c139508f
[Feature] Add precomputed custom voices and Qwen3-TTS ref-context cache ( #3492 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Dan250124 <416947747@qq.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-31 17:51:24 +00:00
Qing An and Samit
57e5f0fe69
[model, omni] feat: Qwen3-Omni Thinker LoRA for RL training ( #3915 )
...
Signed-off-by: Qing An <qa4@rice.edu >
Co-authored-by: Samit <285365963@qq.com >
2026-06-01 00:10:14 +08:00
ChenWenjing
5dfdf584dd
[Feat]audio streaming input for async chunk ( #3614 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-05-31 17:39:25 +08:00
Yuanheng Zhao and Zheng Wengang
ea6d811b58
[Config Refactor] Migrate Ming-flash-omni-2.0 Image-Gen deploy configs ( #3975 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
2026-05-30 08:13:21 +00:00
Viacheslav Klimkov and Yueqian Lin
914e92cf80
[Refactor][Qwen3-TTS] Extract reusable prompt-embeds builder and make tts_pad_embed a persistent buffer ( #3992 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-30 16:11:00 +08:00
nperraud
9fdb3bcb89
[Bugfix][Model] Qwen3-TTS: don't collapse 2D ref_code list when estimating prompt length ( #3940 )
...
Signed-off-by: nperraud <nathanael.perraudin@gmail.com >
2026-05-29 09:18:25 -06:00
amy-why-3459 and Hongsheng Liu
2696751003
[Perf] Qwen3-Omni performance optimization ( #3878 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-29 22:15:23 +08:00
boatman and sphinxkkkbc
4d9262a6eb
[Feat]Support voice clone for omnivoice in online serving & add seed parameter for reproducible ( #3668 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-29 07:42:08 +00:00
amy-why-3459
5dd1d0a772
[BugFix] Fix prefix-caching issue ( #3726 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-29 01:51:54 +00:00
Dakai An
bb9f21d0db
Fix Qwen3-omni accuracy degradation from deepstack inputs under torch.compile ( #3885 )
...
Signed-off-by: Dakai An <dakaian108@gmail.com >
2026-05-28 23:57:56 +08:00
Nick Cao and Claude
c20afebce4
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively ( #3360 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-28 16:20:49 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
0f3264a9c0
[Perf][Bugfix] cache hot buffers in qwen3_tts talker; fall back on evicted state ( #3688 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-28 05:45:54 +00:00
BeatSeat
dab596e468
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules ( #3886 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
2026-05-27 23:41:35 -05:00
Sy03 and Yueqian Lin
d37912b071
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving ( #3773 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-27 13:25:49 -05:00
a698269e47
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage ( #2875 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-05-27 23:21:20 +08:00
Dan
1f1c82ecdd
[BugFix] Fix Qwen3-TTS Code2Wav compatibility with transformers >= 5.9.0 ( #3880 )
...
Signed-off-by: Dan250124 <416947747@qq.com >
2026-05-26 16:24:43 +00:00
8f45e68bcd
[Higgs-Audio] bosonai/higgs-audio-v2-generation-3B-base TTS model support ( #3762 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-25 23:16:07 +08:00
Yueqian Lin and Rein Yang
e996723bc9
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness ( #3665 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
the ci failure case is irrelavent to this PR and occurs rarely
2026-05-25 23:09:38 +08:00
BeatSeat and Yueqian Lin
28ce618f0e
[Model] Add GLM-TTS text-to-speech model support ( #3141 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-24 05:42:26 +08:00
amy-why-3459 and Hongsheng Liu
748470c1fb
[BugFix] code2wav supports disabling CUDA graph. ( #3732 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-24 00:05:55 +08:00
e7644daa7f
[Perf] [OmniVoice] Triton kernel fusion + CUDA Graph acceleration ( #3336 )
...
Signed-off-by: univa-HARRY <harry@univa.co.kr >
Signed-off-by: Harry <harry@univa.co.kr >
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-22 13:12:47 +00:00
Jialong Liu and Hongsheng Liu
5799d85a51
[Bugfix] Revert MiMo-Audio local_sampler to greedy to fix text truncation under concurrent batching (followup to #3686 ) ( #3817 )
...
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-22 19:25:37 +08:00
baonudesifeizhai
076c34abfb
（Phase 2）Add ModelOpt mixed FP8/NVFP4 support for image generation ( #3570 )
...
Signed-off-by: roG0d <baonudesifeizhai@gmail.com >
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com >
2026-05-22 10:39:10 +08:00
Jialong Liu and Yueqian Lin
e949ccf087
[Bugfix] Fix MiMo-Audio voice instability: stochastic local_sampler + codec streaming context ( #3686 )
...
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-21 10:18:00 -04:00
Siyuan Kong
7d9d8aee79
[Bugfix] Fix qwen2_5_omni weight loading ( #3598 )
...
Signed-off-by: ksiyuan <ksiyuan@umich.edu >
2026-05-21 16:43:33 +08:00
Canlin Guo
2aafe0bf94
[Perf] Optimize sampler D2H sync for HY-Image ( #3617 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-20 15:40:34 +08:00
Yueqian Lin
fc8486cf20
[Doc][TTS] CosyVoice3 online docs + residual TTS yaml cleanup + remove VoxCPM v1 ( #3748 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-20 15:24:06 +08:00
Nick Cao
06ab723afc
[Perf][VoxCPM2][Ming-Flash-Omni] Use global CUDA graph pool ( #3361 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-20 05:01:42 +00:00
Sy03 and amy-why-3459
ab59673f21
[Bugfix][Qwen3-Omni] Handle short Code2Wav chunk outputs ( #3687 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-18 18:59:23 +00:00
c99df1ebd9
[TTS][Perf] Optimize Qwen3-TTS high-concurrency serving ( #3662 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-17 16:58:59 -04:00
4e88053750
[BugFix][HunyuanImage3] Set MRoPE dynamic_arg_dims so graph mode can compile ( #3630 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: Codex <codex@openai.com >
2026-05-17 22:42:59 +08:00
Yuanheng Zhao
a64ebf103b
[Refactor] Migrate and clean up TTS configs: CosyVoice3, OmniVoice, VoxCPM ( #3338 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-17 07:32:34 +08:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
Y. Fisher
779bf3118b
[Bugfix] fix compatibility of _hunyuan_image3_unpack_packed_topk between vllm / vllm ascend ( #3640 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
2026-05-15 17:35:22 +08:00
amy-why-3459
e7ee5de09f
[BugFix] Fix the issue of thinker requests being preempted, causing shape mismatch. ( #3147 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-15 17:07:42 +08:00
NATURE and Hongsheng Liu
82a0b3a467
[2/5] [core]refactor communication layer: PR 2 of 5 Qwen3 Omni non async ( #2677 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-15 14:14:08 +08:00
bjf-frz and Canlin Guo
f7161b07d0
[Bugfix]Allow HunyuanImage3 AR sampler batching ( #3590 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-05-14 09:27:59 +00:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
