Hongsheng Liu
622c6f5f14
Merge branch 'main' into dev/rebase-v0.16.0
2026-02-13 06:05:57 +08:00
liuzhenwei
00bd07b82b
[XPU] Update Bagel's flash_attn_varlen_func to fa utils ( #1295 )
...
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com >
2026-02-12 21:33:06 +08:00
Taichang Zhou and Cursor
e2ced80d59
Merge origin/main into dev/rebase-v0.16.0.
...
Resolve arg_utils merge conflict and align CI base image tag to v0.16.0 for the vLLM rebase track.
Co-authored-by: Cursor <cursoragent@cursor.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-02-12 21:18:03 +08:00
dsinghvi and 汪志鹏
c6f314df4f
[Feature]: Diffusion sleep to use process level memory calculation ( #1276 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-12 12:17:54 +00:00
Ding Zuhao and 汪志鹏
b16965dfa7
[Feature][Bugfix] Add CFG feature to Bagel ( #1310 )
...
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-12 19:48:30 +08:00
knlnguyen1802
9994594782
[Misc] Support WorkerWrapperBase and CustomPipeline for Diffusion Worker ( #764 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
2026-02-12 19:23:51 +08:00
Yuanheng Zhao and Samit
8bf849c399
Refactor CPU Offloading Backend Pattern ( #1223 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-02-12 17:29:55 +08:00
Sihao Li
71c9e77606
[Feature] add Tensor Parallelism to SD_3.5 ( #1336 )
...
Signed-off-by: GG-li <3226868735@qq.com >
2026-02-12 07:33:23 +00:00
tzhouam
3e89c99001
Merge remote-tracking branch 'remotes/origin/main' into dev/vllm-align
2026-02-12 07:16:25 +00:00
Samit and Flora Feng
9c00852d85
[Feature] Support Wan2.2 T2V and I2V Online Serving with OpenAI /v1/videos API ( #1073 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Signed-off-by: SamitHuang <285365963@qq.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-02-12 14:28:32 +08:00
tzhouam and Cursor
50f2b1e854
Merge origin/main into dev/vllm-align
...
Co-authored-by: Cursor <cursoragent@cursor.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-12 03:41:38 +00:00
SYLAR
830d261f9d
[Feature]: FP8 Quantization Support for DiT ( #1034 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-02-11 21:01:35 +08:00
tzhouam
279b6b5050
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-11 01:44:54 +00:00
SYLAR and Hongsheng Liu
8a9644c821
[Bugfix] Fix image edit RoPE crash when explicit height/width are provided ( #1265 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-10 21:18:36 +00:00
汪志鹏
8228b5a8fe
[Bagel]: Support TP ( #1293 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-02-11 00:17:44 +13:00
Canlin Guo
e192b0a6c5
[Misc] Add per-request generator_device to online image gen and edit ( #1183 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-10 18:47:08 +08:00
dongbo910220 and hsliuustc0106
43e8747c00
[Feat]: support VAE patch parallelism ( #756 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-02-10 17:36:10 +08:00
Yan Ma
9327cccde6
[Bugfix] Fix 'NoneType' AttributeError in stable-diffusion model detect ( #1254 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-02-10 15:25:08 +08:00
JohnJan
f73fa1fbe7
[feature]: support Flux.1-dev CFG-Parallel ( #1269 )
2026-02-10 14:54:35 +08:00
tzhouam
c3d35ed5fe
pass local t2i test
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-10 06:20:26 +00:00
tzhouam
064595a97c
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-10 02:22:49 +00:00
tzhouam
e0f540fe98
Enhance Dockerfile.ci to synchronize flashinfer runtime package versions with installed flashinfer-python, ensuring compatibility across components. Additionally, improve error handling in ring_globals.py for flashinfer import failures, logging warnings for fallback scenarios.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-10 02:17:00 +00:00
Jiaping Wu
5fea4823b7
[Model] SupportHunyuanImage3 Diffusion Model in vllm-omni ( #1085 )
...
Signed-off-by: Semmer2 <semmer@live.cn >
2026-02-10 03:03:44 +13:00
Junhong Liu and Hongsheng Liu
9af6fb9a1f
[Feature] Opt metrics structure ( #891 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 19:17:32 +08:00
XU Mingshi
ac397ae2a0
[Diffusion][Perf] Remove Redundant Communication Cost by Refining SP Hook Design ( #1275 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
2026-02-09 19:10:10 +08:00
XU Mingshi and Hongsheng Liu
11a5a914ca
[Bugfix] Fix wan2.2 ti2v ( #1221 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-06 17:28:49 +08:00
weichen
c4933ec2aa
[Wan 2.2][Diffusion] Add TP Support ( #964 )
...
Signed-off-by: weichen <calvin_zhu0210@outlook.com >
2026-02-05 18:11:12 +08:00
JohnJan and Jiangyun Zhu
8135ee81e6
[feature]: support flux cache_dit ( #1145 )
...
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-02-04 22:10:04 +08:00
WeiQing Chen
38ec7eda90
[Bugfix] Fix tp+sp accuracy, incorrect process group mapping ( #1178 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-02-04 16:54:47 +08:00
Jensen
176fa4bc6e
[chore] Remove zmq context initialize ( #1187 )
...
Signed-off-by: xiedeyantu <czjourney@163.com >
2026-02-04 06:34:15 +00:00
erfgss and Copilot
78830562db
[Perf] resolving prolonged cudastreamsynchronize execution in z image processing ( #1105 )
...
Signed-off-by: erfgss <97771661+erfgss@users.noreply.github.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-04 10:35:28 +08:00
Zeyu Huang | 黃澤宇 and Hongsheng Liu
7672298075
bugfix: /images/edits endpoint fails pipeline data format check ( #1141 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-04 09:36:57 +08:00
Jiangyun Zhu
4d8e29075a
[Bugfix] fix qwen image oom ( #1168 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-02-03 18:13:00 +08:00
Canlin Guo
3bc3c95708
[Bugfix][Qwen-Image-Edit] Add a warning log for none negative_prompt ( #1170 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-03 18:12:11 +08:00
Zhou Taichang
d6f93b0f37
[Debug] Correct Unreasonable Long Timeout ( #1175 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-03 08:49:51 +00:00
XU Mingshi and Hongsheng Liu
9494d691bf
[CI] Refactor test_sequence_parallel.py and add a warmup run for more accurate performance stat ( #1165 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-03 12:23:15 +08:00
Rustam Khadipash
dc6177520e
[Feature] add Tensor Parallelism to LongCat-Image(-Edit) ( #926 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-02-02 10:28:25 +00:00
汪志鹏 and Hongsheng Liu
0f0e94760c
[TeaCache]: Add Coefficient Estimation ( #940 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 22:06:17 +13:00
ed89c8b043
[Bugfix] Fix NPU SDPA attention mask shape and semantics ( #1031 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: muziyuhui666 <111362884+muziyuhui666@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 14:14:15 +08:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Canlin Guo
4eeea68cff
[Platform] Add supports_torch_inductor interface ( #1108 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-30 15:21:43 +00:00
XU Mingshi and Hongsheng Liu
be835c4483
[BugFix] Fix modulate_index shape error in Qwen-Image-Edit Task ( #1100 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 13:44:58 +00:00
2923d5a91e
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading ( #858 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 17:35:09 +08:00
Fanli Lin and Copilot
bfbf3e5b69
[Feat] Support XPU Backend in vLLM-Omni ( #191 )
...
Signed-off-by: Fanli Lin <fanli.lin@intel.com >
Signed-off-by: Fanli Lin <fanli0116@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-01-30 04:33:05 +13:00
Fanli Lin and Samit
c7f89ef085
[Wan2.2] Optimize memory usage with conditional transformer loading ( #980 )
...
Signed-off-by: Lin, Fanli <fanli.lin@intel.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-29 22:02:24 +08:00
dsinghvi
f8dd566abd
[BugFix] Fix to use correct attn backend ( #1038 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
2026-01-29 21:20:39 +08:00
JohnJan
ee0f7a7797
[feat]: adapt batch request for flux ( #1028 )
...
Signed-off-by: wuzhongjian wuzhongjian_yewu@cmss.chinamobile.com
2026-01-29 20:19:31 +08:00
Canlin Guo
0c8b5ac2d5
[Bugfix] Set VaeImageProcessor do_convert_rgb True ( #1032 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-29 12:02:39 +00:00
XU Mingshi and Hongsheng Liu
5b8ade8446
[Diffusion][Bugfix] Fix the flash_attn backends selection logic ( #983 )
...
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-29 16:44:58 +08:00
Zhou Taichang and root
def39561ae
[Debug] Update GLM-Image Pipeline ( #1049 )
...
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-29 16:03:27 +08:00
Hongsheng Liu