tzhouam
22e01c416b
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-25 08:15:55 +00:00
Junhong Liu and Hongsheng Liu
c0908dd3fa
[Bugfix] Forward all vllm-omni serve command parameters to model ( #985 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 22:20:01 +08:00
36b8f80266
[Feature] Support Stage Based Deployment CLI ( #939 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-24 16:55:23 +08:00
tzhouam
81b9e40bbf
Enhance signature compatibility checks in OmniLLM tests
...
- Improved the test_overridden_method_signatures_compatible function to better handle missing parameters in method signatures.
- Added logic to account for VAR_KEYWORD parameters, ensuring more accurate detection of signature mismatches.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 07:56:47 +00:00
tzhouam
04ccb062fc
Add signature compatibility tests for OmniLLM class
...
- Introduced tests to ensure method signatures in OmniLLM match those of the base LLM class, preventing runtime TypeErrors due to parameter mismatches.
- Updated the _run_engine method in OmniLLM to include an optional output_type parameter.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 06:58:39 +00:00
tzhouam
861698f88f
Update Dockerfile for vllm wheel version and enhance SHM connector tests
...
- Updated Dockerfile to use a new vllm wheel version.
- Modified test_put_get_inline to clarify that it always uses SHM and updated metadata assertions.
- Added handling for speculative configuration in GPU model runners to delay clearing connector metadata.
- Refactored payload decoding in OmniGPUModelRunner for better clarity and maintainability.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 05:45:48 +00:00
NATURE
1589931fa6
[Feature] vLLM-Omni RDMA connector ( #1019 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-02-24 11:13:52 +08:00
Alicia
7b02b856a6
[CI] Set L2 & L3 tests running conditions. ( #1344 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-02-24 10:50:10 +08:00
Sy03 and Hongsheng Liu
efbe4116ff
[Feature] : Support disaggregated inference pipeline for Qwen3_TTS ( #1161 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-21 07:36:44 +08:00
wangyu
a42b7487b0
[Test] Fix expansion and example test case for qwen3-omni ( #1358 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-15 00:43:38 +13:00
75770c9309
[Rebase] Rebase to vllm v0.16.0 ( #1357 )
...
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com >
Co-authored-by: youkaichao <youkaichao@gmail.com >
2026-02-13 18:05:07 +08:00
wangyu
f4867ec175
[Test] Add Omni Model Performance Benchmark Test ( #1321 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-02-12 23:11:57 +08:00
rein yang and Hongsheng Liu
36a79717c6
change qwen3-omni open cudagraph by default ( #1352 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-12 20:49:34 +08:00
dsinghvi and 汪志鹏
c6f314df4f
[Feature]: Diffusion sleep to use process level memory calculation ( #1276 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-12 12:17:54 +00:00
knlnguyen1802
9994594782
[Misc] Support WorkerWrapperBase and CustomPipeline for Diffusion Worker ( #764 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
2026-02-12 19:23:51 +08:00
dengyunyang
b0a5ffa100
[Bugfix] remove Tongyi-MAI/Z-Image-Turbo related test from L2 ci ( #1348 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-02-12 18:44:05 +08:00
Yuanheng Zhao and Samit
8bf849c399
Refactor CPU Offloading Backend Pattern ( #1223 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-02-12 17:29:55 +08:00
John Liu BUAA
f117a07271
[Bugfix] reused metrics to modify the API Server token statistics in Stream Response ( #1301 )
...
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
2026-02-12 17:24:01 +08:00
ab1acb27ff
[Feature]async scheduling to overlap chunk IO and compute ( #951 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Bhanu068 <voutharoja.bhanu06@gmail.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-02-12 16:05:02 +08:00
Samit and Flora Feng
9c00852d85
[Feature] Support Wan2.2 T2V and I2V Online Serving with OpenAI /v1/videos API ( #1073 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Signed-off-by: SamitHuang <285365963@qq.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-02-12 14:28:32 +08:00
20a8fe1dcc
[Test] L2 & L3 Test Case Stratification Design for Omni Model ( #1272 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-12 09:56:35 +08:00
Junhong Liu
82fd2c3637
Fix yield token metrics and opt metrics record stats ( #1292 )
2026-02-12 00:52:05 +08:00
SYLAR
830d261f9d
[Feature]: FP8 Quantization Support for DiT ( #1034 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-02-11 21:01:35 +08:00
dongbo910220 and hsliuustc0106
43e8747c00
[Feat]: support VAE patch parallelism ( #756 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-02-10 17:36:10 +08:00
Yueqian Lin
f55ce9c793
[Test] Add e2e tests for Qwen3-TTS speech endpoint ( #1206 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-02-10 16:33:39 +08:00
amy-why-3459
ee624d0686
[BugFix] Fixed the issue where ignore_eos was not working. ( #1286 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-10 16:08:20 +08:00
Alicia
26ba1e4de8
[CI] Reduce the time for Diffusion Sequence Parallelism Test ( #1283 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-02-10 01:48:04 +13:00
b81e0a8abf
[Test] Add example test cases for omni online ( #1086 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-09 20:08:46 +08:00
Junhong Liu and Hongsheng Liu
9af6fb9a1f
[Feature] Opt metrics structure ( #891 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 19:17:32 +08:00
Alicia and Hongsheng Liu
d3ea94309d
[CI] Add pytest markers to current tests and update the doc. ( #577 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 16:49:45 +08:00
dsinghvi
59024bee62
Process-Scoped GPU Memory Accounting ( #1204 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
2026-02-08 22:43:02 +08:00
ApsarasX
87847a214a
[Bugfix] Ensure seed=0 is correctly handled in image edit ( #1248 )
...
Signed-off-by: ApsarasX <apsarax@outlook.com >
2026-02-07 07:09:54 +08:00
wangyu and wangyu31577
9f00a37437
[Test] Add BuildKite test-full script for full CI. ( #867 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-02-06 01:19:46 +08:00
Yan Ma
ffbc1305e6
[XPU] Fix XPU UTs for basic coverage ( #1164 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-02-05 15:04:57 +00:00
wangyu and wangyu31577
398ae95b96
[CI] Add CI branch coverage calculation, fix statement coverage results and add log before test for buildkite log group ( #1120 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-02-05 10:54:40 +08:00
WeiQing Chen
38ec7eda90
[Bugfix] Fix tp+sp accuracy, incorrect process group mapping ( #1178 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-02-04 16:54:47 +08:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
XU Mingshi and Hongsheng Liu
9494d691bf
[CI] Refactor test_sequence_parallel.py and add a warmup run for more accurate performance stat ( #1165 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-03 12:23:15 +08:00
Alicia and princepride
47b11c6b13
[CI] Temporarily remove slow tests. ( #1143 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
2026-02-02 20:36:56 +08:00
汪志鹏 and Hongsheng Liu
de0a8b057b
[CI]: Bagel E2E Smoked Test ( #1074 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 22:08:22 +13:00
dengyunyang
70a5de9dd4
[FEATURE] /v1/images/edit interface ( #1101 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-01-31 14:13:36 +08:00
2e6895ff0e
[Bugfix][Qwen3TTS] Load speaker_id/voices from model configuration ( #1079 )
...
Signed-off-by: pablo <juanz9312@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-01-31 10:42:09 +08:00
07f4c3fdd6
[Bugfix] fix benchmark audio timing error and add benchmark test ( #1109 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 10:15:26 +08:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Jiangyun Zhu and Hongsheng Liu
8ad39570b8
[Bugfix] fix request_id of image generation in api server ( #1112 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 00:05:34 +08:00
f6cfc0d1e3
[BugFix] Fix Qwen3 Omni talker mtp torch.compile startup error ( #1104 )
...
Signed-off-by: ram16g <anlianfengjie@163.com >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: ram16g <anlianfengjie@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 23:25:49 +08:00
2923d5a91e
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading ( #858 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 17:35:09 +08:00
Andy Zhou
c7fb59fd28
[Fix] Increase max wait time for server readiness to accommodate model loading ( #1089 )
...
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
2026-01-30 11:27:19 +08:00
dongbo910220
3eecd2057b
[Fix] stabilize diffusion images LoRA E2E across CI drift ( #1075 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
2026-01-30 00:28:29 +08:00
Ziming Huang
c48a9f33ad
[CI] Change Qwen3 Omni stage placement strategy ( #1072 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
2026-01-30 02:10:09 +13:00
tzhouam