tzhouam
22e01c416b
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-25 08:15:55 +00:00
Juan Pablo Zuluaga and pablo
4de077ea62
[Qwen3TTS][Feat] Code2Wav batched decoding ( #1426 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-02-25 11:16:46 +13:00
Canlin Guo and Hongsheng Liu
af11b02081
[Minor][Refactor] Pass seq_token_counts explicitly ( #1425 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 14:10:00 +08:00
tzhouam
9070f15f52
debug qwen tts
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 03:17:11 +00:00
tzhouam
bf69cd94bb
Rebase 2026/02/23
...
Update Dockerfile for vllm wheel version and enhance input processing in Omni models. Added decoding for byte messages in async requests, included new metrics in benchmarks, and improved pause state handling in the scheduler. Refined input and output processing methods for better multimodal support and error handling.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-23 03:36:01 +00:00
Sy03 and Hongsheng Liu
efbe4116ff
[Feature] : Support disaggregated inference pipeline for Qwen3_TTS ( #1161 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-21 07:36:44 +08:00
75770c9309
[Rebase] Rebase to vllm v0.16.0 ( #1357 )
...
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com >
Co-authored-by: youkaichao <youkaichao@gmail.com >
2026-02-13 18:05:07 +08:00
0b56fba7b3
[Pref] Support Qwen3 Omni code2wav batch infernce with async chunk ( #1246 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: Ziming Huang <1520787127@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-12 11:50:10 +08:00
Ekagra Ranjan
dd302b63c4
[Bugfix][Qwen3-TTS] Fix task type ( #1317 )
...
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com >
2026-02-11 15:49:15 +08:00
rein yang
963b64e7ae
[Bugfix] fix precision issues of qwen3-omni when enable async_chunk without system prompt ( #1288 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-02-11 10:03:41 +08:00
Yueqian Lin
53a44c56fe
[Bugfix] Fix padding bug in 12Hz tokenizer ConvTranspose1d decode ( #1241 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-02-08 00:35:49 +08:00
Canlin Guo
285d71b26a
[Refactor] Reuse upstream Qwen3MoeSparseMoeBlock ( #1202 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-06 01:06:50 +00:00
Zhou Taichang
f1960d8dfd
[Feature] Enable use_audio_in_video for Qwen 3 Omni Online ( #1198 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-04 20:48:25 +08:00
amy-why-3459
5304bc1e16
[Refactor] Refactor async chunk and fix the shape mismatch issue ( #1151 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-04 00:00:56 +08:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
Markus / Mark
425952e7d3
[BugFix] Fix Qwen3 TTS 0.6B profile run hang ( #995 ) ( #1082 )
2026-01-31 08:00:03 +08:00
f6cfc0d1e3
[BugFix] Fix Qwen3 Omni talker mtp torch.compile startup error ( #1104 )
...
Signed-off-by: ram16g <anlianfengjie@163.com >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: ram16g <anlianfengjie@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 23:25:49 +08:00
Fanli Lin and Copilot
bfbf3e5b69
[Feat] Support XPU Backend in vLLM-Omni ( #191 )
...
Signed-off-by: Fanli Lin <fanli.lin@intel.com >
Signed-off-by: Fanli Lin <fanli0116@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 04:33:05 +13:00
Ziming Huang and Hongsheng Liu
a909d36415
[Perf] Qwen3 Omni talker mtp optimization ( #1005 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-29 21:23:19 +08:00
amy-why-3459 and Rein Yang
dd518973de
[BugFix] Fix the accuracy issue of multimodal input. ( #1020 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
2026-01-29 19:30:11 +08:00
Canlin Guo
c9392dff01
[Hardware] Support platforms and plugin system ( #774 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-28 22:12:52 +08:00
amy-why-3459
d2b3a24af3
[BugFix] Modify the method of obtaining external_request_id ( #961 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-01-27 20:56:02 +08:00
Yuanheng Zhao
2f5e32477c
[NFC] Remove redundant torch.no_grad in models and pipelines ( #854 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-01-27 12:36:54 +00:00
Canlin Guo
cadd77262d
[NPU] Upgrade to v0.14.0 ( #820 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-27 16:45:32 +08:00
Yueqian Lin
77ff875170
Support Qwen3 tts online serving ( #968 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-01-27 14:37:21 +08:00
52bf1e2f40
[Feature]Support async computation and communication across stages by chunks ( #727 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-26 11:21:24 +08:00
21ee1ff6e6
[bugfix] qwen3-tts check_model_inputs ( #924 )
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
Co-authored-by: shijin zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: ning ding <nndding@gmail.com >
2026-01-23 09:37:53 +00:00
Zhou Taichang
e3b6254090
debug Qwen TTS ( #902 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-01-22 15:28:56 +00:00
汪志鹏 and wzliu
7f821be57b
Support Bagel Model ( #726 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: wzliu <wzliu@connect.hku.hk >
2026-01-22 23:09:55 +13:00
Gao Han
a54c323952
[Model] Support Qwen3-TTS model series ( #895 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-22 16:57:37 +08:00
John Liu BUAA
c3894585b5
[Perf] Fuse Q/K/V Linear with QKVParallelLinear in Qwen2.5Omni DiTAttention ( #884 )
...
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
2026-01-21 09:24:05 +00:00
+13
776c3a794e
Dev/rebase 0.14.0 ( #847 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: root <root@hk01dgx039.cm.cluster >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: TangPeng <85704592@qq.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
Signed-off-by: Dinesh G <G.Dinesh@ibm.com >
Signed-off-by: gDINESH13 <dinesh13g@gmail.com >
Signed-off-by: root <root@hk01dgx028.cm.cluster >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: root <root@hk01dgx039.cm.cluster >
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com >
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-21 00:25:25 +08:00
John Liu BUAA
bb24e07a7a
[Perf] Optimize the Qwen2.5-Omni Model thinker-to-talker-proj with nn.Linear ( #825 )
...
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
2026-01-17 19:47:11 +08:00
Peiqi Yin
35f994e255
[BugFix] Qwen2.5-omni supress end token and won't stop ( #773 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
2026-01-16 00:41:59 +08:00
Ziming Huang
1444e1fc45
[Feature] Support Qwen3 Omni talker mtp batch inference ( #722 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-14 19:07:31 +08:00
Zhou Taichang and root
2e13bddf87
[Debug] Clean code in Qwen 3 Omni and add warning for talker temperature. ( #688 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-12 23:13:45 +13:00
Junhong Liu
d0836d8459
[Bugfix] Fix multi-audio input shape alignment for Qwen3-Omni Thinker ( #697 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
2026-01-12 13:16:29 +08:00
Canlin Guo
dde96c2468
[Perf][Qwen3-Omni] Fuse QKV linear and gate_up proj ( #734 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-11 11:06:24 +08:00
Canlin Guo and Isotr0py
9c2f7467a0
[Perf] Use vLLM's SharedFusedMoE in Qwen3-Omni ( #560 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-01-10 04:30:06 +00:00
Ziming Huang
978e3ad7d4
[Feature] Support Qwen3 Omni talker cudagraph ( #669 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-09 11:45:58 +08:00
Ziming Huang
cddcc400d3
[BugFix] Fix stage engine outputs mismatch bug in online batching ( #691 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-09 04:01:57 +13:00
dengyunyang
b60030092c
[BugFix] token2wav code out of range ( #655 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-01-06 11:05:08 +08:00
Dong W and Hongsheng Liu
c1ebb60747
[Bugfix]Fix Qwen 2.5 omni hardcoded max_mel_frames to resolve shape mismatch ( #543 )
...
Signed-off-by: Dong Wang <dongw2019@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-01 17:12:03 +13:00
Gao Han
9c7de5373a
[Feature]Basic version of supporting streaming output ( #367 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-01 03:02:04 +13:00
Ziming Huang and Hongsheng Liu
1ae0c64fe0
Support Qwen3 Omni thinker cuda graph ( #523 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-30 23:46:13 +13:00
Zhou Taichang
59ae174bba
[Debug] Debug qwen3 mix modality output empty string ( #431 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-12-30 15:32:15 +08:00
Canlin Guo and Hongsheng Liu
52d15c4c04
[NPU][Model] Support Qwen3-Omni on NPU ( #484 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-27 00:05:55 +13:00
Peiqi Yin
e9e6b3711c
[Core] customize process between stages, remove the need of "request_ids" in model forward, rebase to 0.12.0 ( #458 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
2025-12-24 13:26:33 +00:00
Peiqi Yin
da7f25e14b
[BugFix] Qwen3-Omni / Qwen2.5-Omni thinker batching with audio input ( #451 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
2025-12-24 18:43:00 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
tzhouam