tzhouam
7f54fd2f54
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-06 02:26:06 +00:00
Canlin Guo
285d71b26a
[Refactor] Reuse upstream Qwen3MoeSparseMoeBlock ( #1202 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-06 01:06:50 +00:00
tzhouam
41e22e2770
[Refactor] Clean up code by removing unnecessary lines and adding missing imports in async_omni_llm.py, omni_stage.py, omni.py, and api_server.py
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-05 11:02:03 +00:00
tzhouam
24b04f58a0
rebase 2026/2/5
2026-02-05 10:52:28 +00:00
weichen
c4933ec2aa
[Wan 2.2][Diffusion] Add TP Support ( #964 )
...
Signed-off-by: weichen <calvin_zhu0210@outlook.com >
2026-02-05 18:11:12 +08:00
tzhouam
0144a424ed
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-05 01:44:34 +00:00
JohnJan and Jiangyun Zhu
8135ee81e6
[feature]: support flux cache_dit ( #1145 )
...
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-02-04 22:10:04 +08:00
amy-why-3459
d1cf4c4c0f
[Bugfix] async_chunk rebase v0.15.0 ( #1195 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-04 20:50:09 +08:00
Zhou Taichang
f1960d8dfd
[Feature] Enable use_audio_in_video for Qwen 3 Omni Online ( #1198 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-04 20:48:25 +08:00
WeiQing Chen
38ec7eda90
[Bugfix] Fix tp+sp accuracy, incorrect process group mapping ( #1178 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-02-04 16:54:47 +08:00
Junhong Liu and Hongsheng Liu
959b3ca8c8
[Bugfix] E2E metric incorrect qwen3-omni with async chunk feature ( #1018 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-04 15:27:30 +08:00
Jensen
176fa4bc6e
[chore] Remove zmq context initialize ( #1187 )
...
Signed-off-by: xiedeyantu <czjourney@163.com >
2026-02-04 06:34:15 +00:00
wangyu and wangyu31577
117d9bd122
[Bugfix] modify RTF use audio_e2e/audio_duration ( #1157 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-02-04 14:07:46 +08:00
erfgss and Copilot
78830562db
[Perf] resolving prolonged cudastreamsynchronize execution in z image processing ( #1105 )
...
Signed-off-by: erfgss <97771661+erfgss@users.noreply.github.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-04 10:35:28 +08:00
Zeyu Huang | 黃澤宇 and Hongsheng Liu
7672298075
bugfix: /images/edits endpoint fails pipeline data format check ( #1141 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-04 09:36:57 +08:00
amy-why-3459
5304bc1e16
[Refactor] Refactor async chunk and fix the shape mismatch issue ( #1151 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-04 00:00:56 +08:00
liuzhenwei
6c19f3e386
[Hardware] Disable compile of diffusion on XPU ( #1148 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-02-03 12:28:06 +00:00
Jiangyun Zhu
4d8e29075a
[Bugfix] fix qwen image oom ( #1168 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-02-03 18:13:00 +08:00
Canlin Guo
3bc3c95708
[Bugfix][Qwen-Image-Edit] Add a warning log for none negative_prompt ( #1170 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-03 18:12:11 +08:00
Zhou Taichang
d6f93b0f37
[Debug] Correct Unreasonable Long Timeout ( #1175 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-03 08:49:51 +00:00
tzhouam
02c6062908
Merge branch 'main' into dev/vllm-align
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-03 05:57:38 +00:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
XU Mingshi and Hongsheng Liu
9494d691bf
[CI] Refactor test_sequence_parallel.py and add a warmup run for more accurate performance stat ( #1165 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-03 12:23:15 +08:00
Rustam Khadipash
dc6177520e
[Feature] add Tensor Parallelism to LongCat-Image(-Edit) ( #926 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-02-02 10:28:25 +00:00
tzhouam
ce9105267f
Enhance error handling in TTS generation and improve audio output compatibility by supporting both "audio" and "model_outputs" keys in response.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 08:40:56 +00:00
tzhouam
6568a78a26
Remove unused tokenizer argument from OmniInputProcessor class docstring
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 03:12:43 +00:00
tzhouam
ff8b3dbbc8
update qwen 2.5 Omni
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 03:01:11 +00:00
tzhouam
1297a46040
Merge remote-tracking branch 'origin/main' into dev/vllm-align
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 01:54:12 +00:00
ceanna93 and anna
df3b347cd9
[Misc] Align error handling with upstream vLLM v0.14.0 ( #1122 )
...
Signed-off-by: anna <lee.anna@navercorp.com >
Co-authored-by: anna <lee.anna@navercorp.com >
2026-02-01 21:59:08 +08:00
Roger Wang
81774fd933
[Misc] Bump version to 0.14.0 ( #1128 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
2026-02-01 00:09:43 -08:00
汪志鹏 and Hongsheng Liu
de0a8b057b
[CI]: Bagel E2E Smoked Test ( #1074 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 22:08:22 +13:00
汪志鹏 and Hongsheng Liu
0f0e94760c
[TeaCache]: Add Coefficient Estimation ( #940 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 22:06:17 +13:00
ed89c8b043
[Bugfix] Fix NPU SDPA attention mask shape and semantics ( #1031 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: muziyuhui666 <111362884+muziyuhui666@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 14:14:15 +08:00
dengyunyang
70a5de9dd4
[FEATURE] /v1/images/edit interface ( #1101 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-01-31 14:13:36 +08:00
Canlin Guo
722a69e8d1
[NPU] Align with GPUModelRunner ( #1114 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-31 04:26:34 +00:00
2e6895ff0e
[Bugfix][Qwen3TTS] Load speaker_id/voices from model configuration ( #1079 )
...
Signed-off-by: pablo <juanz9312@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-01-31 10:42:09 +08:00
07f4c3fdd6
[Bugfix] fix benchmark audio timing error and add benchmark test ( #1109 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 10:15:26 +08:00
Markus / Mark
425952e7d3
[BugFix] Fix Qwen3 TTS 0.6B profile run hang ( #995 ) ( #1082 )
2026-01-31 08:00:03 +08:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Jiangyun Zhu and Hongsheng Liu
8ad39570b8
[Bugfix] fix request_id of image generation in api server ( #1112 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 00:05:34 +08:00
f6cfc0d1e3
[BugFix] Fix Qwen3 Omni talker mtp torch.compile startup error ( #1104 )
...
Signed-off-by: ram16g <anlianfengjie@163.com >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: ram16g <anlianfengjie@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 23:25:49 +08:00
Canlin Guo
4eeea68cff
[Platform] Add supports_torch_inductor interface ( #1108 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-30 15:21:43 +00:00
XU Mingshi and Hongsheng Liu
be835c4483
[BugFix] Fix modulate_index shape error in Qwen-Image-Edit Task ( #1100 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 13:44:58 +00:00
amy-why-3459 and Hongsheng Liu
e6b9d52905
[BugFix] Modify max_tokens and modify the log and fix #1103 ( #1097 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 01:50:23 +13:00
tzhouam
7aea8e8d91
Add OmniMRotaryEmbedding for multimodal position computation
...
- Introduced OmniMRotaryEmbedding to extend MRotaryEmbedding with methods for computing input positions across various multimodal scenarios, including image, video, and audio inputs.
- Updated patch.py to replace the original MRotaryEmbedding with OmniMRotaryEmbedding in the module patching logic.
- Created new files for the OmniMRotaryEmbedding implementation and its associated methods.
Signed-off-by: [Your Name] <[Your Email]>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-30 10:03:02 +00:00
tzhouam
3208afd82b
Refactor OmniRequestOutput to encapsulate multimodal output
...
- Changed the multimodal_output field to a private attribute _multimodal_output for better encapsulation.
- Added a property method to access multimodal_output, allowing for a clearer interface and improved handling of request outputs.
Signed-off-by: [Your Name] <[Your Email]>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-30 10:02:22 +00:00
tzhouam
2b009b3cef
Fix audio tensor extraction in end2end.py files across multiple examples
...
- Updated the audio tensor extraction logic to access the correct output structure in Qwen2.5 Omni, Qwen3 Omni, and Qwen3 TTS implementations.
- Ensured consistency in handling audio outputs for improved functionality.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-30 10:00:14 +00:00
2923d5a91e
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading ( #858 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 17:35:09 +08:00
Pierre LE GUEN
2c294a750b
fix: UnboundLocalError for role in streaming audio/image responses ( #784 )
...
Signed-off-by: Pierre Le Guen <26087574+PierreLeGuen@users.noreply.github.com >
2026-01-30 16:27:04 +08:00
NATURE
790e34e375
[Bugfix] Remove Mooncake/Yuanrong connector import warning ( #1091 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-01-30 13:26:29 +08:00