anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,641 Commits 235 Branches 31 Tags
339761045f4bd9704672e27cfa9ebac0349e6b8d
Commit Graph
103 Commits
Author SHA1 Message Date
Hongsheng Liu 339761045f [Core] Make post-load publication warm-only 
Close publication leases inside Host Weight Runtime, return only the publication report, and cover the new terminal mappings. Rename the runtime test module to avoid the pytest basename collision reported in #6436.

Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 12:18:12 +08:00
Hongsheng Liu 4c773109b1 [Core] Add post-load host weight publication 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 09:05:34 +08:00
Hongsheng Liu 73b623f2f7 [Core] Add Host Weight Runtime foundation (#6419) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 08:50:59 +08:00
Yukim1 6f55a06fab [Docs] Remove stale stage config references (#6270) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-08-20 07:09:12 +08:00
Hongsheng Liu 284e05c88b [Core] Support online FP8 with DLO AllGather (#6279) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-18 23:48:07 +08:00
Wang fuyinandHongsheng Liu e1c5f59aab [Config] Reuse vLLM configs in VllmOmniConfig (#6050) 
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-18 21:27:58 +08:00
Hongsheng Liu 9d2bb23ff6 [Diffusion] Add loader-owned host-weight plans for DLO (TP=1) (#6213) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-16 11:02:38 +08:00
Jack Chenzhangbin.327Hongsheng Liu
 		3875f8ded4 [Core] Add realtime AR-Diffusion tick sessions for LingBot World 2.0 (#5491) 
Signed-off-by: zhangbin.327 <zhangbin.327@bytedance.com>
Signed-off-by: Jack47 <scsvip@gmail.com>
Co-authored-by: zhangbin.327 <zhangbin.327@bytedance.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-16 09:11:20 +08:00
SYLARandHongsheng Liu d1e230c95b [Diffusion][Quantization] Enable MiniMax-H3 global FP8 with DLO (#5910) 
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-15 23:01:26 +08:00
Samit 136cb27b05 [Bugfix] Fix lost async diffusion outputs in request-level batching (#6023) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-08-15 18:27:51 +08:00
Hongsheng Liu 1260ceaae6 [Docs] Split diffusion attention and CPU offload guides (#6075) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-15 14:41:09 +08:00
vraitiandClaude Opus 4.6 c98517ce7f [Metrics] Add Diffusion Metrics (#4755) 
Signed-off-by: vraiti <vraiti@redhat.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-08-13 06:59:13 +00:00
Hongsheng Liu 1ff2753469 docs: align User Guide feature taxonomy (#6045) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-12 00:20:56 +08:00
Hongsheng Liuhsliu_ustcCopilot Autofix powered by AI
 		5e4b9f8c6e [Misc] Align CODEOWNERS with module/feature design docs (#5958) 
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
 2026-08-10 19:25:03 +08:00
Hongsheng Liu 9159cedbd7 docs: update vLLM-Omni architecture overview (#5914) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-09 09:16:18 +08:00
Hongsheng Liu fd0e92183a [Docs] [templates] Reorganize module design documentation (#5139) 
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-08 11:39:27 +08:00
Hongsheng Liu 62bf8d630d docs: document distributed layerwise offload compatibility (#5839) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-06 23:21:43 +08:00
Zijun HuangandWeiQing Chen 93457f29ff [NPU][Quantization] Add RainFusion attention and INT8 online quantization for MiniMax H3 (#5706) 
Signed-off-by: Zijun Huang <zijunhua@usc.edu>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
 2026-08-06 14:15:21 +08:00
Hongsheng Liu bc95e7415f docs: reorganize vLLM-Omni design navigation (#5833) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-06 12:32:56 +08:00
bjf-frz 9f978923f2 [docs] consolidate diffusion execution modes (#5599) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
 2026-08-05 22:41:18 +08:00
Chenguang Zheng d5d47e9be1 [Doc] Document async Omni output materialization (#5610) 
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
 2026-08-04 14:50:38 +08:00
Yukim1 7a2007cc17 [Refactor] Remove legacy --stage-configs-path from the serve CLI (#5647) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-08-03 23:41:52 +08:00
akshatvishu cd5daaea6a [BugFix][Metrics] Fix per-stage time and token stats in metrics API (#4974) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-08-01 03:54:17 +00:00
zzhanddengyunyang dba05c3517 Enable Diffusion Image models asynchronous output (#4981) 
Signed-off-by: zzh <943967662@qq.com>
Co-authored-by: dengyunyang <584797741@qq.com>
 2026-07-29 17:21:55 +00:00
wangyu 7c17111ff5 [Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-29 23:53:03 +08:00
SYLARandlishunyang12 7762d664d8 [Attention] Add trtllm diffusion attention backend with Skip-Softmax (#5283) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-07-27 22:48:11 +08:00
Yang_wdrs 8927ec057c [Refactor][1/N]diffusion/cache: cache-dit (#5226) 
Signed-off-by: yangjianjuan <66548561+yangjianjuan@users.noreply.github.com>
 2026-07-24 22:42:45 +08:00
Diya Peng acf941da4d [Diffusion] Add VAE patch parallel support for FLUX.2-dev (#5292) 
Signed-off-by: dpeng123 <diyapeng123@gmail.com>
 2026-07-24 07:00:57 +00:00
Jack Chen 96235da468 Generalize AR-Diffusion KV session capabilities (#5271) 
Signed-off-by: Jack47 <scsvip@gmail.com>
 2026-07-23 12:37:32 +08:00
bjf-frzandHongsheng Liu be667a8067 [Refact] Refactor diffusion output streaming (#5166) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-23 10:06:08 +08:00
Zeyu Huang | 黃澤宇CursorHongsheng Liu
 		f43d761c26 [Refactor]: clean up diffusion worker interfaces (#5217) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-22 17:07:09 +08:00
Zeyu Huang | 黃澤宇Copilot Autofix powered by AICursor
 		e39f4dddfb [Refactor]: clean up diffusion scheduler interfaces (#5216) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-22 14:05:49 +08:00
Bingyu (Spencer) Liu dcf8b07d39 [Core] Cleanup Omni connector runtime and transfer backends (#5096) 
Signed-off-by: spencerr221 <liubingyu62@gmail.com>
 2026-07-22 09:44:15 +08:00
Hongsheng Liuandhsliu_ustc 625892032b [Doc] Standardize serving names and identifiers (#5081) 
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
 2026-07-13 23:59:42 +08:00
Hongsheng Liu a6da469134 docs: update README for v0.24.0 (#5060) 
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
 2026-07-13 08:26:37 +08:00
Zeyu Huang | 黃澤宇andHongsheng Liu 1b0de21c55 [Chore]: refactor out unused/redundant params in diffusion pipelines (#1235) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-02 16:32:05 +02:00
JiangJie ZhangandSamit c45ac74d43 [Core][Frontend] Support request-level batching for diffusion pipelines (#4079) 
Signed-off-by: jader <yjader@foxmail.com>
Co-authored-by: Samit <285365963@qq.com>
 2026-06-29 18:09:19 +02:00
Rahul SteigerandHongsheng Liu 327e9dcaf2 [Feature] Spatially-sharded (SP) decode for the Wan VAE (#4620) 
Signed-off-by: Rahul Steiger <rsteiger@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-27 09:01:25 +08:00
inkcherryzejwangjunkang1991Zejian WangZejian WangCursor
 		e1b0b83238 add moriio transfer engine (#1742) 
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Signed-off-by: zejwang  <zejwang@amd.com>
Signed-off-by: junkang1991 <junkangchow@gmail.com>
Signed-off-by: Zejian Wang <zejianwang@sjtu.edu.cn>
Co-authored-by: zejwang <zejwang@amd.com>
Co-authored-by: junkang1991 <junkangchow@gmail.com>
Co-authored-by: Zejian Wang <zejianwang@sjtu.edu.cn>
Co-authored-by: Zejian Wang <Zejian.Wang@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-10 08:37:33 +08:00
Alex Brooks 7dcbeaea03 [Core] Cleanup DiffusersPipelineLoader (#1932) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-09 11:55:32 +08:00
rein yangandHongsheng Liu 3a7c7f1422 [Bugfix] fix qwen3-omni performance regression (#3575) 
Signed-off-by: rein yang <ruiruyang2@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-02 23:02:07 +08:00
LHXuuuandvraiti 41a795b5d6 [Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:* (#3576) 
Signed-off-by: vraiti <vraiti@redhat.com>
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: vraiti <vraiti@redhat.com>
 2026-06-01 20:20:48 +08:00
JiangJie Zhang 6fa9dbbe42 [Diffusion] Unify diffusion request identity on request_id (#3744) 
Signed-off-by: jader <yjader@foxmail.com>
 2026-05-28 14:56:56 +08:00
Samit 083b5e363f [Diffusion] Support LoRA in step-wise execution (#3639) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-05-20 22:26:18 +08:00
yangsonglin13 1c530d984d Yuanrong TransferEngine Connector for NPU (#3180) 
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com>
 2026-05-20 14:51:33 +08:00
Rustam Khadipash 89f8819525 [Feature] Add support for Pipeline Parallel and integrate it into Wan 2.2 (#2322) 
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com>
 2026-05-19 09:42:17 +08:00
Canlin GuoandHongsheng Liu ef7f2f1cd2 [Docs] Refactor the attention backend docs/skill (#3475) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-11 09:13:07 +08:00
Ting FUasukaqaq-sjaderHongsheng LiuGao Han
 		e49fbd8a2d [Feat] DiffusionEngine Support async batch infer (#2729) 
Signed-off-by: Semmer <semmer@live.cn>
Signed-off-by: jader <yjader@foxmail.com>
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Co-authored-by: asukaqaq-s <1311722138@qq.com>
Co-authored-by: jader <yjader@foxmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-05-06 09:47:13 +12:00
rein yang d435fe0707 [Docs] update documents (#2921) 
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
 2026-04-20 12:55:04 +08:00
Alex Brooks f346f2fdc6 Add Teacache Support for LongCat Image (#1487) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-18 07:52:35 +08:00