anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,550 Commits 235 Branches 31 Tags
1c3d59796f92b89555a4e7ecd9df73186651dffc
Commit Graph
492 Commits
Author SHA1 Message Date
Hongsheng Liu 1c3d59796f [Diffusion] Document DLO mmap model opt-in 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-15 06:57:38 +08:00
Hongsheng Liu 2956af1e9d [Diffusion] Add rank-local mmap storage for DLO 
Decouple node-local checkpoint storage from the DLO AllGather transfer protocol. Compatible rank-local workers retain shared file-backed sources and stream complete blocks through bounded staging without changing request scheduling.

Refs #6195

Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-14 14:38:06 +08:00
Bo Lilishunyang12Claude Opus 5
 		596c16a550 [Kernel] Fuse Q/K RMSNorm and RoPE (#5990) 
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 00:46:59 +00:00
Mu GuanLin 83d1f11449 [Feat] LTX Standard Two-Stage Pipeline (#5500) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-08-14 00:13:14 +08:00
MaciejBalaNV e677360168 Add cosmos-guardrail dependency and update error message (#6107) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
 2026-08-12 17:04:07 +00:00
Wenjia LiandHongsheng Liu 38a2500bdf [Perf] MiniMax H3 Qwen3-VL support fused RMSNorm on NPU (#5915) 
Signed-off-by: Wenjia Li <wjialish@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-12 19:12:54 +08:00
Zhou TaichangandClaude Opus 5 2ce15ab7a0 [Rebase] Rebase to vllm 0.27.0 (#5976) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-11 15:23:46 +00:00
Jerry Song 89015d5cad [Feature]: Adds distilled LoRA support for diffusion models (#2783) 
Signed-off-by: Songrui625 <songrui625@gmail.com>
 2026-08-11 14:23:43 +00:00
KristofferDidan DengHongsheng Liu
 		4ab1b4ff9c [Perf][Flux2][HunyuanVideo1.5] Skip attention-mask to avoid varlen path (#4645) 
Signed-off-by: kTorp <Kristoffer.Torp@amd.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-11 15:31:02 +08:00
WeiyanDidan DengHongsheng Liu
 		06e733d3cd [Model] Add LongCat-Video-Avatar-1.5 ai2v, at2v support (#4099) 
Signed-off-by: weiyan <weiyanlin117@gmail.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-11 15:17:17 +08:00
Zijun HuangandWeiQing Chen 1a56953d7a [NPU][Model] Add distilled 4-step sigma schedule support for MiniMax H3 t2va (#5991) 
Signed-off-by: Zijun Huang <zijunhua@usc.edu>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
 2026-08-11 13:46:10 +08:00
WeiQing Chen 1f65814fab [CI] Align MiniMax H3 Ref2VA inputs and add I2VA/Ref2VA accuracy coverage (#5978) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-08-11 13:36:37 +08:00
ooooooye 740f45abcd [Perf][Diffusion] MiniMax-H3: opt into packed varlen attention on NPU to eliminate quadratic mask materialization (#5891) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-08-10 19:47:03 +08:00
R0CKSTAR 636d44e272 [Perf][MUSA] Restore MiniMax-H3 dynamic RoPE fusion (#5881) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-08-10 17:24:46 +08:00
wtz2333andClaude 36135ef09a [diffusion][feature] Add LingBot-Video T2I and TI2V generation modes (#5311) 
Signed-off-by: wtz2333 <2955110911@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-08-10 10:02:31 +08:00
Yukim1zwhzzz0821Hongsheng Liu
 		6ae7ff7846 [Diffusion] Prepare HunyuanImage3 for Scheduler-managed paged KV cache (#5541) 
Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-10 08:48:56 +08:00
linzhenpl07andClaude Opus 4.8 8e2e9b6b53 [Feat] Cosmos3 session-memory port for UND text K/V (RFC #4480 Phase 0) (#4657) 
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-08-09 20:53:17 +08:00
Shenglei FuandClaude Opus 5 81b48e83ec [Model] Fail MiniMax H3 encoder load when a weight or fused shard is missing (#5824) 
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-08 13:14:00 +08:00
Mu GuanLin d8c35663b4 [Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-08-07 09:07:23 +00:00
Isotr0pylishunyang12SYLARDavid Chen
 		48298030d4 [Diffusion] Add Minimax-H3 modular pipeline support (#5720) 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: David Chen <530634352@qq.com>
 2026-08-06 11:43:23 +00:00
Bo Lilishunyang12lishunyang12
 		d219d93bbb [Attention] Refine TRTLLM attention support for MiniMax H3 (#5779) 
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang12@163.com>
 2026-08-06 09:38:17 +00:00
Zijun HuangandWeiQing Chen 93457f29ff [NPU][Quantization] Add RainFusion attention and INT8 online quantization for MiniMax H3 (#5706) 
Signed-off-by: Zijun Huang <zijunhua@usc.edu>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
 2026-08-06 14:15:21 +08:00
ooooooye f879ad4983 fix(minimax-h3): pass device_type to fork_rng so VAE condition encode works on NPU devices (#5837) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-08-06 03:56:55 +00:00
fan2956andFan f2e3d2e25b [Perf] Minimax-H3 support fused RMSNorm and RoPE opt (#5801) 
Signed-off-by: Fan <fan@FandeMacBook-Air.local>
Co-authored-by: Fan <fan@FandeMacBook-Air.local>
 2026-08-06 11:39:27 +08:00
SYLARandlishunyang12 1c2a81f6d8 feat(minimax-h3): enable 2x RTX 4090/5090 with DLO (#5764) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-06 09:02:29 +08:00
R0CKSTAR 2eada79b99 [Hardware][MUSA] Make MiniMax H3 conditioned VAE RNG device-aware (#5703) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-08-05 03:11:46 -07:00
WeiQing Chen ae7bee0c43 [Feature] Align MiniMax H3 official input matrix (#5752) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-08-05 07:12:01 +00:00
Atharv Arun Chivate c9f2e5ad94 fix(bagel): correct CFG position ID concatenation for multimodal RoPE (#5775) 
Signed-off-by: atharv0o <missionblood2@gmail.com>
 2026-08-05 01:53:59 +08:00
Mu GuanLin b9a51592f0 [Model][Feat] MiniMax H3 online FP8 support (#5737) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-08-04 11:35:01 +00:00
ooooooye a4ea67a21b [Model] Add soundfile fallback for MiniMax H3 audio loading (#5699) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-08-03 16:24:50 +08:00
Isotr0py 24741961eb [Model] Add MiniMax H3 diffusion support (#5691) 2026-08-03 14:10:40 +08:00
SYLARandlishunyang12 4b1547b4d8 [Bugfix] Fix Wan2.2 omitted guidance scale resolution (#5615) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-01 15:17:33 +00:00
Harenome 安仁 Ranaivoarivony-Razanajato 8cb79308c6 diffusion: Fix silent override of explicit guidance_scale=0 (#4999) 
Signed-off-by: Harenome Ranaivoarivony-Razanajato <harenome.razanajato1@huawei.com>
 2026-08-01 03:19:21 +00:00
akshatvishu 4563999ec0 [BugFix][Diffusion] Add CPU LAPACK fallback for FlowUniPC (#5329) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-07-30 15:09:48 +00:00
Alex Brooks 089bb88706 [Model] Remove Text Encoder Output Layer Hardcoding in Flux2 (#5589) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-30 09:55:42 +00:00
TaffyOfficialandTaffyOfficial 0c88f8a0b6 [Refactor] Normalize diffusion request extra arguments in Chat serving (#5171) 
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
 2026-07-30 07:08:12 +00:00
Mu GuanLin 1b718f7b15 [Feat] [CI] [bugfix] Generalize LTX CFG parallelism to the complete guidance plan (#5547) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-07-29 17:40:40 +00:00
zzhanddengyunyang dba05c3517 Enable Diffusion Image models asynchronous output (#4981) 
Signed-off-by: zzh <943967662@qq.com>
Co-authored-by: dengyunyang <584797741@qq.com>
 2026-07-29 17:21:55 +00:00
R0CKSTAR ab0da662c0 [Hardware] Enable CosyVoice3 on Moore Threads MUSA (#5164) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-07-29 02:46:27 +00:00
Zhang Jian fa41fdf252 [recipe][NPU] add cosmos3-super recipe on 8xA3 (#5097) 
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
 2026-07-29 08:29:33 +08:00
Mu GuanLin 12d75cf63a [Feature] Add official LTX multimodal guidance and precision guard (#5148) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-07-28 10:44:25 +00:00
Zhou TaichangClaude Fable 5tzhouam
 		cbab1d4d8f [Rebase] Rebase to vllm 0.26.0 (#5443) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: tzhouam <tzhouam@gmail.com>
 2026-07-27 23:35:49 +08:00
SYLARandlishunyang12 7762d664d8 [Attention] Add trtllm diffusion attention backend with Skip-Softmax (#5283) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-07-27 22:48:11 +08:00
jiangmengyu18betta18Hongsheng Liu
 		e108cbb510 [NPU][HunyuanImage3] Adapt diffusion FusedMoE for vLLM >= 0.24.0 (#5167) 
Signed-off-by: betta18 <jiangmengyu1@huawei.com>
Signed-off-by: jiangmengyu18 <56633611+jiangmengyu18@users.noreply.github.com>
Co-authored-by: betta18 <jiangmengyu1@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-27 22:41:34 +08:00
汪志鹏 88b7ca2ffa [Model] Support MammothModa2-Dev (#5411) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-07-27 17:01:54 +08:00
Zeyu Huang | 黃澤宇 eaf90d8eff [Frontend] Add midway prompt update for streaming video generation (#4652) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
 2026-07-27 14:07:43 +08:00
wjsuijlenh 1f01d05603 [Core] Session state manager for AR-diffusion world models (RFC #4480 Phase 0) (#4487) 
Signed-off-by: Wijnand Suijlen <wijnand.suijlen@huawei.com>
 2026-07-27 13:17:38 +08:00
Honghan ZhuClaude Opus 4.7dengyunyang
 		84bbd57e4d [Feature] Add AllGather-KV sequence-parallel attention str… (#4968) 
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Signed-off-by: dph97 <nenbaying@163.com>
Signed-off-by: zhuhh97 <zhh@unknown>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: dengyunyang <584797741@qq.com>
 2026-07-24 14:45:26 +00:00
Yang_wdrs 8927ec057c [Refactor][1/N]diffusion/cache: cache-dit (#5226) 
Signed-off-by: yangjianjuan <66548561+yangjianjuan@users.noreply.github.com>
 2026-07-24 22:42:45 +08:00
akshatvishuandHongsheng Liu 536daea107 [BugFix] Fix Helios Cholesky positive-definite crashes and CPU LAPACK… (#4921) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-24 19:41:56 +08:00