Taichang Zhou and Claude Opus 4.8
9678ae58cf
[MR V2] Migrate to Model Runner V2
...
Squashed migration rebased onto current main. Collapses the 46-commit
dev/migrate-MR-v2 history (10 merge commits + superseded pre-rebase work)
into a single commit, so the diff reflects only the genuine MR-V2 feature
(worker_v2/ runners + model_states, omni schedulers, stage engine pipeline,
pooling_output serialization bridge). Content already merged to main
separately (step_audio2, tts_adapters, npu/_310p, etc.) drops out.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-20 07:19:40 +00:00
e1b0b83238
add moriio transfer engine ( #1742 )
...
Signed-off-by: inkcherry <mingzhi.liu@amd.com >
Signed-off-by: zejwang <zejwang@amd.com >
Signed-off-by: junkang1991 <junkangchow@gmail.com >
Signed-off-by: Zejian Wang <zejianwang@sjtu.edu.cn >
Co-authored-by: zejwang <zejwang@amd.com >
Co-authored-by: junkang1991 <junkangchow@gmail.com >
Co-authored-by: Zejian Wang <zejianwang@sjtu.edu.cn >
Co-authored-by: Zejian Wang <Zejian.Wang@amd.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-10 08:37:33 +08:00
Samit
083b5e363f
[Diffusion] Support LoRA in step-wise execution ( #3639 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-05-20 22:26:18 +08:00
yangsonglin13
1c530d984d
Yuanrong TransferEngine Connector for NPU ( #3180 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-05-20 14:51:33 +08:00
Rustam Khadipash
89f8819525
[Feature] Add support for Pipeline Parallel and integrate it into Wan 2.2 ( #2322 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-05-19 09:42:17 +08:00
e49fbd8a2d
[Feat] DiffusionEngine Support async batch infer ( #2729 )
...
Signed-off-by: Semmer <semmer@live.cn >
Signed-off-by: jader <yjader@foxmail.com >
Signed-off-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: asukaqaq-s <1311722138@qq.com >
Co-authored-by: jader <yjader@foxmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-06 09:47:13 +12:00
rein yang
d435fe0707
[Docs] update documents ( #2921 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-04-20 12:55:04 +08:00
Alex Brooks
f346f2fdc6
Add Teacache Support for LongCat Image ( #1487 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-18 07:52:35 +08:00
Alex Brooks
f1e3f03726
[feature] Hidden State Prefix Caching ( #2164 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-15 17:01:45 +00:00
TaffyOfficial
1ad726f495
[Fix] HunyuanImage-3.0: unify naming hunyuan_image_3 → hunyuan_image3 ( #2712 )
2026-04-14 21:53:47 -07:00
amy-why-3459
2a1d5060ab
[skip ci][doc]Update async_chunk design diagram ( #2420 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-13 20:43:40 +08:00
zhou zhuoxin
16041ab550
[Refactor] Extend CFG Parallel to support 3 or 4 branch dispatch across M GPUs ( #2423 )
2026-04-12 22:06:49 +08:00
c3c736d488
[Feature] Port Bagel RDMA flow to latest main ( #2000 )
...
Signed-off-by: Jinheng Li <ahengljh@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: ahengljh <ahengljh@users.noreply.github.com >
Co-authored-by: natureofnature <wzliu@connect.hku.hk >
2026-04-08 14:55:35 +08:00
skf and Canlin Guo
6433847249
[skipCI][Docs] Add expert_parallel.md ( #2471 )
...
Signed-off-by: skf1999 <13234016272@163.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-04-08 02:35:14 +00:00
Canlin Guo and Hongsheng Liu
e771842781
[Feature] Support vae tiling parallel encode ( #2368 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-06 14:47:45 +00:00
Yangshen Deng and Claude Opus 4.6
837679dbaa
[Diffusion] Refactor CFG parallel for extensibility and performance ( #2063 )
...
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-03-30 16:48:58 +00:00
Didan Deng
911be0d426
[skip ci][Doc] Refine the Diffusion Features User Guide ( #1928 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-30 14:28:04 +08:00
dongbo910220 and Didan Deng
c2888a8a36
[Docs] refine UAA documentation ( #2148 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-25 15:46:15 +08:00
dongbo910220 and Didan Deng
50bd1961bf
[Feature]: add Ulysses advanced_uaa mode ( #1379 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-24 14:55:54 +08:00
Lancer and Hongsheng Liu
d8b35035ec
[Bugfix] Fix cache-dit for single-transformer Wan2.2 models(eg. Wan2.2-TI2V-5B) ( #1392 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-22 17:57:28 +08:00
Wu JIAZHEN
da7a8f8014
reafator pipeline stage/step pipeline ( #1368 )
...
Signed-off-by: asukaqaq-s <1311722138@qq.com >
2026-03-20 19:21:50 +08:00
Zhou Taichang
05d8de813e
[Bugfix] Remove duplicated config keyword max batch size ( #1851 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
2026-03-20 16:13:24 +08:00
Alex Brooks and Didan Deng
c8cf8a799d
[Refactor] Use SP Plan for LongCat Sequence Parallelism ( #1772 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-13 11:13:34 +08:00
NATURE
54a999d031
[skip CI][Docs] add connector design document ( #1737 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-03-13 09:23:32 +08:00
rein yang
4725593a4b
[Docs] update async chunk performance diagram ( #1741 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-03-11 10:39:23 +08:00
Juan Pablo Zuluaga and pablo
1d0a97f0d1
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load ( #1714 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-10 21:02:33 +00:00
Juan Pablo Zuluaga and pablo
6a45efb287
[Feat][Qwen3TTS] reduce TTFA with flexible initial phase ( #1583 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-05 23:14:41 +08:00
Alex Brooks
fa944bd8e8
[BugFix] Fix LongCat Sequence Parallelism / Small Cleanup ( #1631 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-03-05 17:31:00 +08:00
dengyunyang
d275c0c993
[FEATURE] Tile/Patch parallelism refactor for easily support other models ( #1366 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-03 15:48:51 +08:00
rein yang
bfcfee7867
[Docs] update async chunk docs diagram [skip ci] ( #1530 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-02-28 10:42:50 +08:00
rein yang
443b80e06c
[skip ci][Doc] add design docs for async chunk in qwen3-omni ( #962 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-02-27 10:46:13 +08:00
Canlin Guo and Hongsheng Liu
f53152d340
[Feature] Support HSDP for diffusion models ( #1339 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:31:10 +08:00
Canlin Guo
9913c00144
[Feature] Support Wan2.2 output with irregular shapes ( #1279 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-26 17:03:43 +08:00
Didan Deng
1e86404456
[Doc] Refine Diffusion Tutorial Documents ( #1305 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-02-25 15:43:08 +08:00
NATURE
1589931fa6
[Feature] vLLM-Omni RDMA connector ( #1019 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-02-24 11:13:52 +08:00
yangsonglin13
16be03b909
[Feature] Implement YuanrongConnector based on OmniConnectorBase ( #716 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-01-27 20:17:02 +08:00
Zhou Taichang
4a26b2eca9
[Docs] Remove multi-request streaming design document and update ray-based execution documentation structure ( #641 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-05 19:09:05 +08:00
Hongsheng Liu and WeiQing Chen
f22944eea4
[Doc] fix docs Feature Design and Module Design ( #283 )
...
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2025-12-12 14:52:53 +08:00
Hongsheng Liu
3e4f7eb9ba
update desgin docs ( #269 )
...
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
2025-12-11 10:22:34 +08:00
Hongsheng Liu
892f837c5a
update docs/readme.md and design folder ( #234 )
...
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
2025-12-08 08:24:16 +00:00
