Taichang Zhou and Claude Opus 4.8
9678ae58cf
[MR V2] Migrate to Model Runner V2
...
Squashed migration rebased onto current main. Collapses the 46-commit
dev/migrate-MR-v2 history (10 merge commits + superseded pre-rebase work)
into a single commit, so the diff reflects only the genuine MR-V2 feature
(worker_v2/ runners + model_states, omni schedulers, stage engine pipeline,
pooling_output serialization bridge). Content already merged to main
separately (step_audio2, tts_adapters, npu/_310p, etc.) drops out.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-20 07:19:40 +00:00
Chendi.Xue and Hongsheng Liu
e7f0db1067
[SDXL] SDXL model enabling ( #4331 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-16 22:51:11 +08:00
46e0b71423
[Enhancement] Introduce High-Performance MoT (Mixture-of-Tokens) Kernels: Triton Implementation ( #3960 )
...
Signed-off-by: Yufeng Zhu <yzhu802@gatech.edu >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu >
Co-authored-by: Yufeng Zhu <yzhu802@gatech.edu >
Co-authored-by: Zhengyuan Su <su.zhengyuan@u.nus.edu >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-16 03:08:02 +00:00
126fb4b4a9
[Blackwell][1/N] Add SageAttention3 diffusion backend on blackwell(GB200/B200/RTX5090/PRO6000/DGX Spark available) ( #3015 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-28 14:08:45 +00:00
373d3c7476
[Blackwell] Add CUDNN_ATTN and FLASHINFER_ATTN backends for diffusion (auto-route) ( #3079 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Co-authored-by: frauttauteffasu <247219357+frauttauteffasu@users.noreply.github.com >
Co-authored-by: Zhang Jian <jianmusings@gmail.com >
2026-05-28 11:09:25 +08:00
Samit
083b5e363f
[Diffusion] Support LoRA in step-wise execution ( #3639 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-05-20 22:26:18 +08:00
Rustam Khadipash
89f8819525
[Feature] Add support for Pipeline Parallel and integrate it into Wan 2.2 ( #2322 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-05-19 09:42:17 +08:00
Canlin Guo and Hongsheng Liu
ef7f2f1cd2
[Docs] Refactor the attention backend docs/skill ( #3475 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-11 09:13:07 +08:00
Nick Cao and Claude
65bc968465
[Refactor] Rename SupportsModuleOffload to SupportsComponentDiscovery ( #3354 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-08 14:16:49 +00:00
Chenguang Zheng
eeb7e698c9
[Clean] Remove multi-replica Bagel CI and related docs/configs ( #3407 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
2026-05-08 09:28:52 +08:00
1e5f288a91
[FEAT] support multi-stage deployment ( #2396 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
2026-05-06 19:33:18 +08:00
Chendi.Xue and Canlin Guo
353ac8a402
[Enhancement] Offload transformer after switch to transformer-2 ( #3224 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-05-05 23:48:46 +00:00
e49fbd8a2d
[Feat] DiffusionEngine Support async batch infer ( #2729 )
...
Signed-off-by: Semmer <semmer@live.cn >
Signed-off-by: jader <yjader@foxmail.com >
Signed-off-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: jader <yjader@foxmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-06 09:47:13 +12:00
WeiQing Chen and SYLAR
954d0642a4
[Docs] Update diffusion quantization guides ( #3200 )
...
Signed-off-by: David Chen <530634352@qq.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-28 04:33:24 -07:00
755a2d9d96
[Feat] support layerwise offload for Bagel ( #2734 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: siyuan.lei <siyuanlei37@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-04-25 15:44:56 +08:00
jiangmengyu18 and betta18
c174c95ab0
[NPU] [Quant] Support HunyuanImage3 offline quantization with vLLM-Ascend on diffusion path ( #2979 )
...
Signed-off-by: betta18 <jiangmengyu1@huawei.com >
Signed-off-by: jiangmengyu18 <56633611+jiangmengyu18@users.noreply.github.com >
Co-authored-by: betta18 <jiangmengyu1@huawei.com >
2026-04-25 06:14:01 +00:00
Lancer and Hongsheng Liu
345504b68f
[Feat] support quantization for GLM-IMAGE ( #2292 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-24 13:49:49 +08:00
WeiQing Chen
d4cbdff9cd
[Doc] Add diffusion attention backend docs ( #3011 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-23 11:30:47 +08:00
Nick Cao and Claude
e3b0afbb97
[Refactor] Let diffusion pipelines declare offloadable modules via SupportsModuleOffload ( #2427 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-23 04:23:00 +08:00
Liang Lv and SYLAR
ee15f39ea7
[AutoRound] Support Qwen Omni W4A16 quantization model ( #2670 )
...
Signed-off-by: lvliang-intel <liang1.lv@intel.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-22 19:54:45 +08:00
Hongsheng Liu
25b451a552
Codex revert pr reviewer ( #2959 )
...
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
2026-04-21 21:43:15 +08:00
WeiQing Chen
6c6551dff8
[Feature] feat: add video frame interpolation postprocess ( #2555 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-04-15 11:52:20 +08:00
Jiaqian Liu and Canlin Guo
8097747a5d
[Model] Adapt Wan2.2-I2V-A14B via LightX2V offline conversion path ( #2134 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-04-13 14:20:04 +08:00
Yuanheng Zhao
8a55d3d01f
[Feat] Enable Layerwise CPU offloading for SD3.5, Ovis-Image, Nextstep_1, LongCat-Image ( #2339 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-08 09:55:09 +08:00
Lancer and Didan Deng
328de586aa
[Feat] support for multi-block layerwise offloading, fix top-level parameters/buffers staying on CPU ( #1486 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Lancer <402430575@qq.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-06 11:49:35 +08:00
Yi Liu and Hongsheng Liu
c1d2dcc3ac
[AutoRound] Add offline quantized W4A16 model support ( #1777 )
...
Signed-off-by: yiliu30 <yi4.liu@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-02 13:57:53 +08:00
Didan Deng
ebc9a8d875
[skip ci][Doc] Small fix of Doc ( #2400 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-02 10:08:58 +08:00
Didan Deng
911be0d426
[skip ci][Doc] Refine the Diffusion Features User Guide ( #1928 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-30 14:28:04 +08:00
rongfu.leng and Hongsheng Liu
9d9e6abae6
[Feat] add helios fp8 quantization ( #1916 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-29 06:35:56 +00:00
Ding Zuhao and 汪志鹏
283a62fd76
[Feature] [HunyuanImage3] Add TeaCache support for inference acceleration ( #1927 )
...
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-28 15:24:21 +00:00
dongbo910220 and Didan Deng
c2888a8a36
[Docs] refine UAA documentation ( #2148 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-25 15:46:15 +08:00
SYLAR
6b93459826
[Core] Unified quantization framework ( #1764 )
2026-03-24 18:56:55 +08:00
dongbo910220 and Didan Deng
50bd1961bf
[Feature]: add Ulysses advanced_uaa mode ( #1379 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-24 14:55:54 +08:00
9bf8f8ce79
[model] support FLUX.1-Kontext-dev ( #561 )
...
Signed-off-by: Lancer <maruxiiang6688@gmail.com >
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Lancer <402430575@qq.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Lancer <maruxiiang6688@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-03-23 17:17:58 +00:00
汪志鹏 and Didan Deng
77d773ad47
[Bagel]: Support SP ( #1903 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-23 21:52:50 +08:00
WeiQing Chen
d6b55b9196
[Quantization] feat: add qwen-image gguf adapter ( #1755 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-03-23 13:24:54 +00:00
zhou zhuoxin and 汪志鹏
b147553d67
[Feature] add Tensor Parallelism to Omnigen2 ( #2065 )
...
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-23 11:46:58 +08:00
6838533998
[Model] Add HunyuanVideo-1.5 T2V and I2V support ( #1516 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-21 21:26:39 +08:00
Wu JIAZHEN
da7a8f8014
reafator pipeline stage/step pipeline ( #1368 )
...
Signed-off-by: asukaqaq-s <1311722138@qq.com >
2026-03-20 19:21:50 +08:00
Samit
4c2293743b
[Docs] Add Wan2.1-T2V as supported video generation models ( #1920 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-03-20 14:14:20 +08:00
b766c4702c
Int8 Quantization Support for DiT (Z-Image & Qwen-Image) ( #1470 )
...
Signed-off-by: juboyu <767868009@qq.com >
Signed-off-by: JuboYu <767868009@qq.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-03-19 22:58:29 +08:00
3158e9d28f
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring ( #1908 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com >
Co-authored-by: wuhang <whlbx@hotmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-03-18 17:33:53 +08:00
Lancer
9aae75c3ee
[Feat] support HSDP for Flux family ( #1900 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-03-15 22:48:12 +08:00
Lancer
2472c360aa
[Feat] support SP for FLUX.2-klein ( #1250 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-03-15 12:18:12 +08:00
dengyunyang
3e8cb6c631
[Diffusion] [Model] Dreamid omni ( #1855 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-13 21:53:06 +08:00
JohnJan and wuzhongjian
4d89ebaa07
[Model]: add FLUX.2-dev model ( #1629 )
...
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com >
2026-03-11 14:44:18 +08:00
Ting FU
6ac85d4607
[Feat] Enable expert parallel for diffusion MoE layers ( #1323 )
...
Signed-off-by: Semmer2 <semmer@live.cn >
2026-03-11 10:45:36 +08:00
Didan Deng
e79ad8d59a
[Doc] CLI Args Naming Style Correction ( #1750 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-09 23:35:45 +08:00
WeiQing Chen
83fe7d005b
[Model] support LTX-2 text-to-video image-to-video ( #841 )
...
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-03-05 23:31:48 +08:00
zhou zhuoxin
58eb1c68db
[FP8 Quantization] Add FP8 quantization support for Flux transformer ( #1640 )
...
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com >
2026-03-05 11:08:34 +08:00
