Taichang Zhou and Claude Opus 4.8
9678ae58cf
[MR V2] Migrate to Model Runner V2
...
Squashed migration rebased onto current main. Collapses the 46-commit
dev/migrate-MR-v2 history (10 merge commits + superseded pre-rebase work)
into a single commit, so the diff reflects only the genuine MR-V2 feature
(worker_v2/ runners + model_states, omni schedulers, stage engine pipeline,
pooling_output serialization bridge). Content already merged to main
separately (step_audio2, tts_adapters, npu/_310p, etc.) drops out.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-20 07:19:40 +00:00
e1b0b83238
add moriio transfer engine ( #1742 )
...
Signed-off-by: inkcherry <mingzhi.liu@amd.com >
Signed-off-by: zejwang <zejwang@amd.com >
Signed-off-by: junkang1991 <junkangchow@gmail.com >
Signed-off-by: Zejian Wang <zejianwang@sjtu.edu.cn >
Co-authored-by: zejwang <zejwang@amd.com >
Co-authored-by: junkang1991 <junkangchow@gmail.com >
Co-authored-by: Zejian Wang <zejianwang@sjtu.edu.cn >
Co-authored-by: Zejian Wang <Zejian.Wang@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-10 08:37:33 +08:00
Alex Brooks
7dcbeaea03
[Core] Cleanup DiffusersPipelineLoader ( #1932 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-09 11:55:32 +08:00
rein yang and Hongsheng Liu
3a7c7f1422
[Bugfix] fix qwen3-omni performance regression ( #3575 )
...
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-02 23:02:07 +08:00
LHXuuu and vraiti
41a795b5d6
[Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:* ( #3576 )
...
Signed-off-by: vraiti <vraiti@redhat.com >
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: vraiti <vraiti@redhat.com >
2026-06-01 20:20:48 +08:00
JiangJie Zhang
6fa9dbbe42
[Diffusion] Unify diffusion request identity on request_id ( #3744 )
...
Signed-off-by: jader <yjader@foxmail.com >
2026-05-28 14:56:56 +08:00
Samit
083b5e363f
[Diffusion] Support LoRA in step-wise execution ( #3639 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-05-20 22:26:18 +08:00
yangsonglin13
1c530d984d
Yuanrong TransferEngine Connector for NPU ( #3180 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-05-20 14:51:33 +08:00
Rustam Khadipash
89f8819525
[Feature] Add support for Pipeline Parallel and integrate it into Wan 2.2 ( #2322 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-05-19 09:42:17 +08:00
Canlin Guo and Hongsheng Liu
ef7f2f1cd2
[Docs] Refactor the attention backend docs/skill ( #3475 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-11 09:13:07 +08:00
e49fbd8a2d
[Feat] DiffusionEngine Support async batch infer ( #2729 )
...
Signed-off-by: Semmer <semmer@live.cn >
Signed-off-by: jader <yjader@foxmail.com >
Signed-off-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: jader <yjader@foxmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-06 09:47:13 +12:00
rein yang
d435fe0707
[Docs] update documents ( #2921 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-04-20 12:55:04 +08:00
Alex Brooks
f346f2fdc6
Add Teacache Support for LongCat Image ( #1487 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-18 07:52:35 +08:00
1637dbaaf3
[skip CI][Docs] Add Qwen3-Omni and Qwen3-TTS performance blog and figures ( #1837 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
2026-04-18 07:50:35 +08:00
Alex Brooks
f1e3f03726
[feature] Hidden State Prefix Caching ( #2164 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-15 17:01:45 +00:00
TaffyOfficial
1ad726f495
[Fix] HunyuanImage-3.0: unify naming hunyuan_image_3 → hunyuan_image3 ( #2712 )
2026-04-14 21:53:47 -07:00
amy-why-3459
2a1d5060ab
[skip ci][doc]Update async_chunk design diagram ( #2420 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-13 20:43:40 +08:00
zhou zhuoxin
16041ab550
[Refactor] Extend CFG Parallel to support 3 or 4 branch dispatch across M GPUs ( #2423 )
2026-04-12 22:06:49 +08:00
c3c736d488
[Feature] Port Bagel RDMA flow to latest main ( #2000 )
...
Signed-off-by: Jinheng Li <ahengljh@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: ahengljh <ahengljh@users.noreply.github.com >
Co-authored-by: natureofnature <wzliu@connect.hku.hk >
2026-04-08 14:55:35 +08:00
skf and Canlin Guo
6433847249
[skipCI][Docs] Add expert_parallel.md ( #2471 )
...
Signed-off-by: skf1999 <13234016272@163.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-04-08 02:35:14 +00:00
Canlin Guo and Hongsheng Liu
e771842781
[Feature] Support vae tiling parallel encode ( #2368 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-06 14:47:45 +00:00
chickeyton
563f73b78a
Refactor StageDiffusionClient and StageEngineCoreClient ( #2006 )
2026-04-03 08:05:19 +00:00
Wu JIAZHEN and jader
3fd4a4dc27
[Feat] Support step-boundary abort in diffusion ( #1769 )
...
Signed-off-by: jader <yjader@foxmail.com >
Signed-off-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: jader <yjader@foxmail.com >
2026-04-01 17:25:02 +08:00
Yangshen Deng and Claude Opus 4.6
837679dbaa
[Diffusion] Refactor CFG parallel for extensibility and performance ( #2063 )
...
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-03-30 16:48:58 +00:00
Didan Deng
911be0d426
[skip ci][Doc] Refine the Diffusion Features User Guide ( #1928 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-30 14:28:04 +08:00
dongbo910220 and Didan Deng
c2888a8a36
[Docs] refine UAA documentation ( #2148 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-25 15:46:15 +08:00
dongbo910220 and Didan Deng
50bd1961bf
[Feature]: add Ulysses advanced_uaa mode ( #1379 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-24 14:55:54 +08:00
61cd532cff
[Refactor] Refactor Diffusion Scheduler/Executor Boundaries and Request State Flow ( #1625 )
...
Signed-off-by: jader <yjader@foxmail.com >
Signed-off-by: JiangJie Zhang <76905040+yJader@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-23 20:25:32 +08:00
Lancer and Hongsheng Liu
d8b35035ec
[Bugfix] Fix cache-dit for single-transformer Wan2.2 models(eg. Wan2.2-TI2V-5B) ( #1392 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-22 17:57:28 +08:00
Wu JIAZHEN
da7a8f8014
reafator pipeline stage/step pipeline ( #1368 )
...
Signed-off-by: asukaqaq-s <1311722138@qq.com >
2026-03-20 19:21:50 +08:00
Zhou Taichang
05d8de813e
[Bugfix] Remove duplicated config keyword max batch size ( #1851 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
2026-03-20 16:13:24 +08:00
3158e9d28f
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring ( #1908 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com >
Co-authored-by: wuhang <whlbx@hotmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-03-18 17:33:53 +08:00
Alex Brooks and Didan Deng
c8cf8a799d
[Refactor] Use SP Plan for LongCat Sequence Parallelism ( #1772 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-13 11:13:34 +08:00
NATURE
54a999d031
[skip CI][Docs] add connector design document ( #1737 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-03-13 09:23:32 +08:00
rein yang
4725593a4b
[Docs] update async chunk performance diagram ( #1741 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-03-11 10:39:23 +08:00
Juan Pablo Zuluaga and pablo
1d0a97f0d1
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load ( #1714 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-10 21:02:33 +00:00
Juan Pablo Zuluaga and pablo
6a45efb287
[Feat][Qwen3TTS] reduce TTFA with flexible initial phase ( #1583 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-05 23:14:41 +08:00
Alex Brooks
fa944bd8e8
[BugFix] Fix LongCat Sequence Parallelism / Small Cleanup ( #1631 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-03-05 17:31:00 +08:00
dengyunyang
d275c0c993
[FEATURE] Tile/Patch parallelism refactor for easily support other models ( #1366 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-03 15:48:51 +08:00
汪志鹏 and Cursor
e37a89ffcb
[Feature]: Support cfg kv-cache transfer in multi-stage ( #1422 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-03-02 05:06:28 +00:00
rein yang
bfcfee7867
[Docs] update async chunk docs diagram [skip ci] ( #1530 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-02-28 10:42:50 +08:00
rein yang
443b80e06c
[skip ci][Doc] add design docs for async chunk in qwen3-omni ( #962 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-02-27 10:46:13 +08:00
Canlin Guo and Hongsheng Liu
f53152d340
[Feature] Support HSDP for diffusion models ( #1339 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:31:10 +08:00
Canlin Guo
9913c00144
[Feature] Support Wan2.2 output with irregular shapes ( #1279 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-26 17:03:43 +08:00
Didan Deng
1e86404456
[Doc] Refine Diffusion Tutorial Documents ( #1305 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-02-25 15:43:08 +08:00
NATURE
1589931fa6
[Feature] vLLM-Omni RDMA connector ( #1019 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-02-24 11:13:52 +08:00
yangsonglin13
16be03b909
[Feature] Implement YuanrongConnector based on OmniConnectorBase ( #716 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-01-27 20:17:02 +08:00
+13
776c3a794e
Dev/rebase 0.14.0 ( #847 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: root <root@hk01dgx039.cm.cluster >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: TangPeng <85704592@qq.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
Signed-off-by: Dinesh G <G.Dinesh@ibm.com >
Signed-off-by: gDINESH13 <dinesh13g@gmail.com >
Signed-off-by: root <root@hk01dgx028.cm.cluster >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: root <root@hk01dgx039.cm.cluster >
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com >
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-21 00:25:25 +08:00
Alicia
314bb4e324
[Doc] Fix mkdocs. ( #785 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-01-15 10:38:27 +08:00
Zhou Taichang
4a26b2eca9
[Docs] Remove multi-request streaming design document and update ray-based execution documentation structure ( #641 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-05 19:09:05 +08:00
