Taichang Zhou
c8b695f181
smaller talker gpu util to avoid oom
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-03-08 01:48:42 +08:00
Taichang Zhou
f405240513
Change pytest fixture scope from "module" to "class" for omni_server and omni_server_no_async_chunk in test_qwen3_tts.py to improve test isolation and resource management.
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-03-07 14:50:59 +08:00
Taichang Zhou
5511bc14c7
Merge origin/main into dev/rebase-v0170
...
- Resolved conflict in vllm_omni/engine/output_processor.py: use tracing_enabled for vLLM v0.17.0 API
- Resolved conflict in vllm_omni/model_executor/models/qwen3_tts/qwen3_tts_code_predictor_vllm.py: keep correct _CodePredictorDecoderLayer.forward()
- Update Dockerfile.ci vLLM wheel commit to b31e9326a (releases/v0.17.0)
Made-with: Cursor
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-03-07 13:18:33 +08:00
Yueqian Lin
3bc89de0c0
Add non-async chunk support for Qwen3-TTS ( #1678 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-06 14:45:32 +08:00
tzhouam
8c41492307
Merge remote-tracking branch 'remotes/origin/main' into dev/rebase-v0169
2026-03-06 03:02:50 +00:00
zhanqiuhu and Yueqian Lin
e643aaec15
[Bugfix] Fix all-silence TTS output: use float32 for speech tokenizer decoder ( #1664 )
...
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-03-06 00:04:26 +08:00
tzhouam
5be08baed3
Merge remote-tracking branch 'remotes/origin/main' into dev/rebase-v0170
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-05 08:53:26 +00:00
Daniel Huang
24c80070d6
Replace hard-coded cuda generator with current_omni_platform.device_type ( #1677 )
...
Signed-off-by: Daniel Huang <daniel1.huang@intel.com >
2026-03-05 06:53:30 +00:00
tzhouam
395eab8984
Merge remote-tracking branch 'remotes/origin/main' into dev/rebase-v0169
2026-03-05 02:29:14 +00:00
1612948062
add support for MammothModa2 model ( #336 )
...
Signed-off-by: HonestDeng <2958906959@qq.com >
Signed-off-by: iwzbi <iwzbi@zju.edu.cn >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: iwzbi <iwzbi@zju.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-04 22:52:56 +08:00
tzhouam
2398a7c1d7
Merge origin/main into dev/rebase-v0170
...
Resolve conflict in omni_generation_scheduler.py: keep both
num_cached_tokens tracking and additional_information caching.
Made-with: Cursor
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-03 14:31:05 +00:00
dengyunyang
d275c0c993
[FEATURE] Tile/Patch parallelism refactor for easily support other models ( #1366 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-03 15:48:51 +08:00
tzhouam
3e539fcb6a
Merge remote-tracking branch 'origin/main' into dev/vllm-align
...
Made-with: Cursor
# Conflicts:
# vllm_omni/entrypoints/openai/serving_chat.py
# vllm_omni/worker/gpu_model_runner.py
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-03 02:57:27 +00:00
汪志鹏 and Cursor
e37a89ffcb
[Feature]: Support cfg kv-cache transfer in multi-stage ( #1422 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-03-02 05:06:28 +00:00
tzhouam
473d3ecd29
Update vLLM wheel version and adjust GPU memory utilization in CI configuration
...
- Updated the vLLM wheel commit hash in Dockerfile.ci to a60985b07eaf0fefa4c353ad2309b745707591ed.
- Modified the mock shared memory handle name in test_basic_connectors.py for clarity.
- Increased GPU memory utilization to 0.9 and adjusted max_num_batched_tokens to 4096 in qwen2_5_omni_ci.yaml to enable testing on H800.
- Refactored GPU model runner classes to remove deprecated activate_lora parameter and ensure compatibility with num_active_loras.
- Enhanced request handling in the OmniGPUModelRunner class to improve streaming request updates.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-02 03:08:45 +00:00
wangyu
cd2234a1bf
[CI] Modify some CI test cases to run on L4 environment to reduce H100 resource usage. ( #1543 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-02-28 14:41:51 +08:00
Chendi.Xue and gcanlin
482f9b89a1
[XPU][NPU][ROCM] enable cpu_offloading flag for non_cuda ( #1488 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-02-27 14:52:15 +08:00
Canlin Guo
3b0c21f94d
[Platform] Enable layerwise offload on all hardware ( #1492 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-27 06:47:28 +08:00
Yuanheng Zhao
ed08a216c1
[Misc] Migrate L1 tests to use pytest-mock ( #1315 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-02-26 17:08:39 +08:00
wangyu
1ae2e1e4c4
[Test] Reduce Perf test case and fix modify stage config ( #1449 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-26 14:20:57 +08:00
Alicia
7b02b856a6
[CI] Set L2 & L3 tests running conditions. ( #1344 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-02-24 10:50:10 +08:00
wangyu
a42b7487b0
[Test] Fix expansion and example test case for qwen3-omni ( #1358 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-15 00:43:38 +13:00
75770c9309
[Rebase] Rebase to vllm v0.16.0 ( #1357 )
...
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com >
Co-authored-by: youkaichao <youkaichao@gmail.com >
2026-02-13 18:05:07 +08:00
rein yang and Hongsheng Liu
36a79717c6
change qwen3-omni open cudagraph by default ( #1352 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-12 20:49:34 +08:00
dengyunyang
b0a5ffa100
[Bugfix] remove Tongyi-MAI/Z-Image-Turbo related test from L2 ci ( #1348 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-02-12 18:44:05 +08:00
Yuanheng Zhao and Samit
8bf849c399
Refactor CPU Offloading Backend Pattern ( #1223 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-02-12 17:29:55 +08:00
20a8fe1dcc
[Test] L2 & L3 Test Case Stratification Design for Omni Model ( #1272 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-12 09:56:35 +08:00
dongbo910220 and hsliuustc0106
43e8747c00
[Feat]: support VAE patch parallelism ( #756 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-02-10 17:36:10 +08:00
Yueqian Lin
f55ce9c793
[Test] Add e2e tests for Qwen3-TTS speech endpoint ( #1206 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-02-10 16:33:39 +08:00
Alicia
26ba1e4de8
[CI] Reduce the time for Diffusion Sequence Parallelism Test ( #1283 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-02-10 01:48:04 +13:00
b81e0a8abf
[Test] Add example test cases for omni online ( #1086 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-09 20:08:46 +08:00
Junhong Liu and Hongsheng Liu
9af6fb9a1f
[Feature] Opt metrics structure ( #891 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 19:17:32 +08:00
Alicia and Hongsheng Liu
d3ea94309d
[CI] Add pytest markers to current tests and update the doc. ( #577 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 16:49:45 +08:00
wangyu and wangyu31577
9f00a37437
[Test] Add BuildKite test-full script for full CI. ( #867 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-02-06 01:19:46 +08:00
Yan Ma
ffbc1305e6
[XPU] Fix XPU UTs for basic coverage ( #1164 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-02-05 15:04:57 +00:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
XU Mingshi and Hongsheng Liu
9494d691bf
[CI] Refactor test_sequence_parallel.py and add a warmup run for more accurate performance stat ( #1165 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-03 12:23:15 +08:00
Alicia and princepride
47b11c6b13
[CI] Temporarily remove slow tests. ( #1143 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
2026-02-02 20:36:56 +08:00
汪志鹏 and Hongsheng Liu
de0a8b057b
[CI]: Bagel E2E Smoked Test ( #1074 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 22:08:22 +13:00
Jiangyun Zhu and Hongsheng Liu
8ad39570b8
[Bugfix] fix request_id of image generation in api server ( #1112 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 00:05:34 +08:00
2923d5a91e
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading ( #858 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 17:35:09 +08:00
dongbo910220
3eecd2057b
[Fix] stabilize diffusion images LoRA E2E across CI drift ( #1075 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
2026-01-30 00:28:29 +08:00
Ziming Huang
c48a9f33ad
[CI] Change Qwen3 Omni stage placement strategy ( #1072 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-30 02:10:09 +13:00
amy-why-3459 and Rein Yang
dd518973de
[BugFix] Fix the accuracy issue of multimodal input. ( #1020 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
2026-01-29 19:30:11 +08:00
20e7310eb1
[Test]Delete skip mark for amd ci test and fix CI failure ( #927 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-29 16:21:24 +13:00
Canlin Guo
c9392dff01
[Hardware] Support platforms and plugin system ( #774 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-28 22:12:52 +08:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
dongbo910220 and Hongsheng Liu
40cbd8ef7f
[Fix] make images LoRA e2e less flaky ( #978 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-27 23:55:05 +08:00
wangyu and wangyu31577
2cc4375df8
[Test] Add chunk e2e test case for CI ( #956 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-27 20:15:56 +08:00
Andy Zhou
d12d3d711b
[test] fix test_image_generation_lora CI timeout ( #975 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
2026-01-27 15:51:51 +08:00
Taichang Zhou