copilot-swe-agent[bot] and hsliuustc0106
b4775d52fe
Extract usage info from text output before modality filtering
...
This ensures that usage/billing data is captured even when text output
is filtered out (e.g., for audio-only requests). Previously, audio-only
requests would return zero usage tokens because the text output was
skipped before extracting usage information.
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 04:11:36 +00:00
copilot-swe-agent[bot] and hsliuustc0106
be7d524326
Fix line length linting issue
...
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 03:07:31 +00:00
copilot-swe-agent[bot] and hsliuustc0106
c7bdfb2934
Add modalities filtering to non-streaming chat completions
...
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 03:04:26 +00:00
汪志鹏
36c28767cd
[Core]Add GPU Diffusion Runner ( #822 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-17 19:49:13 +08:00
John Liu BUAA
bb24e07a7a
[Perf] Optimize the Qwen2.5-Omni Model thinker-to-talker-proj with nn.Linear ( #825 )
...
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
2026-01-17 19:47:11 +08:00
汪志鹏
0888520875
[Bagel] Support Cache-Dit ( #736 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-17 15:21:49 +08:00
Yueqian Lin and Hongsheng Liu
3fb6adc40a
[bugfix] use unipc scheduler for Wan 2.2 ( #804 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-16 12:31:25 +00:00
WeiQing Chen
a7f9926013
[Model] add flux2 klein ( #809 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-01-16 16:32:28 +08:00
Didan Deng
43ec7f701b
[Feature] Flash Attention to Support Attention Mask ( #760 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-01-16 11:01:11 +08:00
Peiqi Yin
35f994e255
[BugFix] Qwen2.5-omni supress end token and won't stop ( #773 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
2026-01-16 00:41:59 +08:00
Ziming Huang
b5cf8806f0
[BugFix] Fix incorrect mrope positions under cuda graph ( #803 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-16 03:24:21 +13:00
Yueqian Lin
aaea77a180
[bugfix] Fix Wan2.2 I2V warmup failure by adding support_image_input attribute ( #791 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-01-15 13:14:34 +00:00
Samit
2d5faf3634
[Bugfix] Fix generation artifacts of Qwen-Image-Edit-2511 and update pipeline DiT param parsing ( #776 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-01-15 11:18:28 +08:00
Yuhan Liu
e213bdd0a4
[BugFix]Remove duplicate error handling for request results ( #781 )
...
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
2026-01-14 20:08:23 +08:00
Ziming Huang
1444e1fc45
[Feature] Support Qwen3 Omni talker mtp batch inference ( #722 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-14 19:07:31 +08:00
catcat
e9a1beec77
[Bugfix] Fix stable diffusion3 compatibility error ( #772 )
...
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
2026-01-13 21:12:32 +08:00
XU Mingshi
8e20b33b38
[Bugfix] Raise ValueError when joint_strategy='rear' and causal=True in Ring Attention ( #767 )
...
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
2026-01-13 17:13:31 +08:00
JustQJ
9cdf592782
[Misc] Enable tensor_parallel_size argument with online serving cmd ( #761 )
...
Signed-off-by: TangPeng <85704592@qq.com >
2026-01-13 15:55:25 +08:00
Chenguang Zheng
7e14c943d5
[Misc] Group omni arguments into OmniConfig section ( #744 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: ZEHNG Chenguang <645327136@qq.com >
Signed-off-by: ZHENG Chenguang <645327136@qq.com >
2026-01-12 23:20:20 +08:00
Prajwal A and zjy0516
779f5987d9
[feature] cpu offloading support for diffusion ( #497 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Prajwal A <prajwalanagani@gmail.com >
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com >
2026-01-12 10:41:18 +00:00
Zhou Taichang and root
2e13bddf87
[Debug] Clean code in Qwen 3 Omni and add warning for talker temperature. ( #688 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-12 23:13:45 +13:00
XU Mingshi
8c7f704c23
[Diffusion][Feature] Implement SP support in LongCatImageTransformer ( #721 )
...
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
2026-01-12 00:22:50 -08:00
Sihao Li and Hongsheng Liu
2c92b63cce
fix:#issue 432 ( #517 )
...
Signed-off-by: GG-li <3226868735@qq.com >
Signed-off-by: Sihao Li <111170255+GG-li@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-12 15:38:47 +08:00
Junhong Liu
d0836d8459
[Bugfix] Fix multi-audio input shape alignment for Qwen3-Omni Thinker ( #697 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
2026-01-12 13:16:29 +08:00
dongbo910220 and Jiangyun Zhu
67c0a17a0e
[Feat] Enable DiT tensor parallel for Diffusion Pipeline(Z-Image) ( #735 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-01-12 11:00:42 +08:00
Canlin Guo
dde96c2468
[Perf][Qwen3-Omni] Fuse QKV linear and gate_up proj ( #734 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-11 11:06:24 +08:00
汪志鹏
0ec2da08de
[BugFix] Fix assuming all stage model have talker ( #730 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-11 01:36:37 +13:00
Canlin Guo and Isotr0py
9c2f7467a0
[Perf] Use vLLM's SharedFusedMoE in Qwen3-Omni ( #560 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-01-10 04:30:06 +00:00
Ziming Huang
978e3ad7d4
[Feature] Support Qwen3 Omni talker cudagraph ( #669 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-09 11:45:58 +08:00
dongbo910220
1467b3e2c7
[BugFix] Remove duplicate width assignment in SD3 pipeline ( #708 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
2026-01-09 08:34:17 +08:00
Jiangyun Zhu
c784b3e07d
[core] add torch compile for diffusion ( #684 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-01-09 04:05:44 +13:00
Ziming Huang
cddcc400d3
[BugFix] Fix stage engine outputs mismatch bug in online batching ( #691 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-09 04:01:57 +13:00
Yuanheng Zhao
4c72b67444
[BugFix] Explicitly release file locks during stage worker init ( #703 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-01-08 20:35:00 +08:00
Junhong Liu
bb13467adc
[Bug fix] fix e2e_total_tokens and e2e_total_time_ms ( #648 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
2026-01-08 20:25:04 +08:00
dsinghvi
8c1259383c
omni entrypoint support tokenizer arg ( #572 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
2026-01-08 15:44:14 +08:00
Didan Deng
4df794bdaa
[Bugfix] Solve Ulysses-SP sequence length not divisible by SP degree (using padding and attention mask) ( #672 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-01-08 00:02:22 +08:00
ApsarasX
89f47c910a
[Bugfix] Fix f-string formatting in image generation pipelines ( #689 )
...
Signed-off-by: ApsarasX <apsarax@outlook.com >
2026-01-07 14:12:58 +00:00
Yueqian Lin and Hongsheng Liu
0cb7ec62da
[Model] Add Stable Audio Open support for text-to-audio generation ( #331 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-07 17:01:06 +08:00
Chenguang Zheng
aaba243832
[BUGFIX] Delete the CUDA context in the stage process. ( #661 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: Chenguang Zheng <645327136@qq.com >
2026-01-06 22:22:04 +08:00
Didan Deng
14c04d0fd4
[Diffusion][Feature] CFG parallel support for Qwen-Image ( #444 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-01-06 17:34:50 +08:00
knlnguyen1802 and Jiangyun Zhu
c32235c4e0
[Docs] Guide for using sleep mode and enable sleep mode ( #660 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-01-06 17:31:51 +08:00
dengyunyang
b60030092c
[BugFix] token2wav code out of range ( #655 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-01-06 11:05:08 +08:00
catcat and Hongsheng Liu
026f613e57
[Misc] Merge diffusion forward context ( #582 )
...
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-05 22:49:03 +08:00
knlnguyen1802
b414a4d15e
Support sleep, wake_up and load_weights for Omni Diffusion ( #376 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
2026-01-05 21:18:11 +08:00
Yueqian Lin
c9a4683a1a
[Bugfix] Fix TI2V-5B weight loading by loading transformer config from model ( #633 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-01-05 20:39:31 +08:00
汪志鹏
e7eeb54e08
[BugFix]Fix text_to_image bagel command error ( #644 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-05 23:22:15 +13:00
Canlin Guo and lishunyang
52afcb6055
[Feature] Support torch profiler across omni stages ( #553 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-01-05 17:32:20 +08:00
927d952405
bugfix: fix longcat-image cache dispatch ( #638 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: DefTruth <qiustudent_r@163.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: SamitHuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
2026-01-05 16:25:20 +08:00
Ziming Huang
f9b8bfd7bb
[BugFix] AttributeError: 'AsyncOmniDiffusion' object has no attribute 'abort' ( #624 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-05 14:53:10 +08:00
汪志鹏
d430beef76
[Bagel]Add image edit ( #588 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-05 12:18:04 +08:00