anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,225 Commits 235 Branches 31 Tags
e8193787cc7fa128d2d1415d83ba8fbef3cfd6b1
Commit Graph
639 Commits
Author SHA1 Message Date
Gao Han e8193787cc Merge branch 'main' into fix/pr4709-review-followup 2026-07-18 11:28:29 +08:00
bastefaniak d09f549e86 [bugfix] Use FlowMatchEulerDiscreteScheduler from diffusers 0.39.0 with correct RNG handling for upcoming Cosmos3 distilled models (#5176) 
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
 2026-07-17 11:38:04 -07:00
Alex Steiner ae949d129f [Bugfix][Quantization] Remap ModelOpt NVFP4 scale tensors (#5087) 
Signed-off-by: Alex Steiner <asteiner@nvidia.com>
 2026-07-16 12:33:57 -07:00
bastefaniak 85f7a5b374 Add Cosmos3 Edge and Distilled checkpoints support (#5001) 
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
 2026-07-16 09:39:40 -07:00
zzh 0a9a5c231e Fix hunyuan ci (#5143) 
Signed-off-by: zzh <943967662@qq.com>
 2026-07-16 14:49:13 +00:00
Honghan Zhuzhuhh97Claude Opus 4.7Gao HanHongsheng Liu
 		f84f0e72fd [Bug Fix] Hunyuan image cfg bugfix (#4752) 
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Signed-off-by: dph97 <nenbaying@163.com>
Co-authored-by: zhuhh97 <z00806815@gmail.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-15 13:08:15 +08:00
wkutak a7b6a174bc Fix loading of ModelOpt FP8 checkpoints for Cosmos3 (#5076) 
Signed-off-by: Wojciech Kutak <wkutak@nvidia.com>
 2026-07-14 17:33:27 -07:00
bjf-frz 1a4a042a83 [REFACT]Refactor diffusion outputs to payload metadata (#4922) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
 2026-07-14 17:24:03 +08:00
Alex Steiner 4b9d09cb87 [Bugfix][Quantization] Support packed parameters with HSDP (#5088) 
Signed-off-by: Alex Steiner <asteiner@nvidia.com>
 2026-07-14 08:24:26 +00:00
Zhang JianandChendi Xue b1809985ef [recipe] Add cosmos3-nano recipe for npu (1xA3) (#4978) 
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Chendi Xue <chendi.xue@intel.com>
 2026-07-14 16:19:44 +08:00
Rahul Steiger 66b9ad287a Extend Cosmos3 CPU offloading to component and layerwise paths (#4695) 2026-07-13 09:48:53 +00:00
Zhou TaichangandClaude Opus 4.8 d3c47efc4f [Rebase] Rebase to vllm v0.25.0 (#5042) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-12 23:39:53 +08:00
Naga Sai Abhinay Devarinti 6581e2afa9 [Model] Add Krea 2 text-to-image diffusion model (#4730) 
Signed-off-by: Abhinay1997 <devarintinagasaiabhinay@gmail.com>
 2026-07-11 16:25:41 -07:00
Isotr0py b95905deb1 [Quantization] Migrate GGUF diffusion model support to OOT plugin (#4769) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-11 18:48:43 +00:00
NumberWan fe478a95ab [BugFix] Restore vllm_c IR op priority and torch.nn.RMSNorm for Qwen-Image (#4964) (#5009) 
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
 2026-07-10 17:39:07 +00:00
Samit a5db2d839a [Diffusion] Improve HuggingFace hub kernel loading in flash_attn_hub (#4977) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-07-09 12:10:10 +08:00
Samit b96bc5ac87 Support HuggingFace kernels package for native diffusion attention backends (#4926) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-07-08 14:34:36 +08:00
Zhang Jian d5e197fb97 [Diffusion][Feature] Add SP for Omnigen2 (#3206) 
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
 2026-07-08 10:29:41 +08:00
Yukim1andAdvik 460a5c6b48 [Refactor] Migrate MammothModa2 and OmniVoice to pipeline registry (#4647) 
Signed-off-by: Advik <scince5678@gmail.com>
Signed-off-by: Nightwing-77 <scince5678@gmail.com>
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: Advik <scince5678@gmail.com>
 2026-07-08 00:44:33 +00:00
Ting FU 815abce2ba [BugFix] fix possible shape mismatch when using ROPE (#4655) 
Signed-off-by: Semmer <semmer@live.cn>
 2026-07-07 17:54:39 +08:00
TaffyOfficialandzuiho 66ec3a2aff [Bugfix] Fix HunyuanImage3 MoE groups for vLLM 0.24 (#4893) 
Signed-off-by: zuiho <2324465096@qq.com>
Co-authored-by: zuiho <2324465096@qq.com>
 2026-07-05 15:37:42 +00:00
Vensen ddba6de2ab [Bugfix][sleep mode]: guard generation on partial wake and ensure wake idempotency (#4834) 
Signed-off-by: vensen <vensenmu@gmail.com>
 2026-07-05 14:50:08 +00:00
Renzheng Wang 02d654760f [BugFix] Drop removed get_cache_scale call in HunyuanImage3 diffusion loader (#4892) 
Signed-off-by: wangrzneu <wangrzneu@gmail.com>
 2026-07-05 09:50:43 +00:00
Zhou Taichang 86bdcaf3d5 [BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366) (#4534) 2026-07-05 07:17:58 +08:00
Yuanheng Zhao e73245c60f [Bugfix] Adapt ZImagePipeline.forward calling in MingImagePipeline with DiffusionRequestBatch (#4866) 
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
 2026-07-04 03:45:49 +00:00
akshatvishu 04f400d36c [Bugfix] Report stepwise Qwen-Image profiler metrics (#4517) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-07-03 04:32:22 +00:00
Mu GuanLin 3023bc40c2 [Feature][Refactor] LTX-2.3 I2V Support, Public Examples, and Shared Pipeline Refactor (#4739) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-07-03 11:29:22 +08:00
CAICAII b443504d61 [Diffusion] Add Diffusers quantization config bridge (#3837) 
Signed-off-by: CAICAIIs <3360776475@qq.com>
 2026-07-03 03:06:44 +00:00
Yuanheng Zhao 06329c6450 [Bugfix] Fix request batching regression on Ming-flash-omni ImageGen (#4837) 
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
 2026-07-03 03:04:17 +00:00
Sean Gillen 431a7c71ac [Model] Cosmos3: Skip unused action conditioning frames (#4789) 
Signed-off-by: Sean Gillen <sgillen@nvidia.com>
 2026-07-03 01:45:44 +00:00
Zeyu Huang | 黃澤宇andHongsheng Liu 1b0de21c55 [Chore]: refactor out unused/redundant params in diffusion pipelines (#1235) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-02 16:32:05 +02:00
tzhouamandClaude Fable 5 35a423c9bd [BugFix][CI] Address review follow-ups from v0.24.0 rebase (#4709) 
Addresses Gaohan123's post-approval review comments on #4709:

- pipeline_dreamzero: restore platform-dispatched synchronize() instead of
  torch.cuda so DreamZero keeps working on non-CUDA hardware (regression
  of #4399 introduced during the rebase).
- omni_scheduler_mixin: drop the VLLM_OMNI_INPUT_WAIT_TIMEOUT_S env-var
  override; the full-payload input-wait timeout is now a plain constant.
- diffusion_worker: implement _DiffusionVllmModelConfig.is_diffusion by
  mirroring upstream ModelConfig.is_diffusion (dLLM canvas_length check)
  and document why omni DiT pipelines must not enable dLLM paths.
- qwen3_tts: make _embedding_dtype a class attribute on the talker and
  prompt-embeds builder so __new__-based test stubs inherit it; remove
  the (duplicated) manual assignments from the preprocess test.
- .buildkite: document why the rebase raised per-step timeouts (steps
  were killed by the old limits, masking real failures; e.g. CustomVoice
  passes in ~9-15 min but cold runs were killed at 20m).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-07-02 07:36:14 +00:00
Jiaqian Liu a25636d780 [NPU] Fix HunyuanImage3 MoE EP+SP parallel mapping (#4344) 
Signed-off-by: Celeste-jq <591998922@qq.com>
 2026-07-02 04:14:12 +00:00
Thanaji Rao Thakkalapelli 1788d76eb3 [Feature] Improve diffusion LoRA compatibility for SDXL (#4825) 
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com>
 2026-07-01 23:41:16 +00:00
Alex BrooksandDidan Deng d526dc93e8 [Fix]: Set .transformer on SenseNova pipeline, warn if no .transformer in CacheDiT summary (#4326) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-07-01 17:40:07 +00:00
Zhou Taichang a560ed184d [Rebase] Rebase to vllm v0.24.0 (#4709) 2026-06-30 19:41:06 +08:00
fywcandprincepride 9a105bf90d [Feat] Support teacache for SenseNova-U1 (#4164) 
Signed-off-by: hanzheli <hanzheli@kuaishou.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
 2026-06-30 09:24:46 +00:00
SYLAR bb8614595d [BugFix][Cosmos3] Pad sound latents so video+sound runs under sequence parallelism (#4678) 
Signed-off-by: lishunyang12 <125541396+lishunyang12@users.noreply.github.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
 2026-06-30 17:23:36 +08:00
boatman 4028680b7e [Perf]: Fused RMSNorm+3D Rope kernel in Sensenova-U1 (#4669) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
 2026-06-30 16:32:47 +08:00
Yi LiuandCopilot 99234881f5 [Quant][AutoRound] Add W4A16 support for Qwen-Image (#3588) 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
 2026-06-30 16:27:28 +08:00
boatmansphinxkkkbc汪志鹏
 		dd3a4d0a29 [Feat] Support CFG-Parallel For Sensenova-U1-8B-MoT (#4188) 
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-06-30 08:03:26 +00:00
Mohammed Saif AbedandClaude 2fc00efa49 [Model] Migrate MammothModa2-Preview example to standard task example + model_extras (#4691) 
Signed-off-by: mo saif <moisf56@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-30 04:34:06 +00:00
JiangJie ZhangandSamit c45ac74d43 [Core][Frontend] Support request-level batching for diffusion pipelines (#4079) 
Signed-off-by: jader <yjader@foxmail.com>
Co-authored-by: Samit <285365963@qq.com>
 2026-06-29 18:09:19 +02:00
SuyanLiandsuyan.li 1b318d11d1 [Refactor] Reuse CFGParallelMixin in Bagel for CFG-parallel denoising (#4768) 
Signed-off-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: suyan.li <suyan.li@bytedance.com>
 2026-06-28 07:16:10 +00:00
Chendi.Xue 60ccadfbb6 [WAN_S2V] Enable HSDP for wan s2v (#4458) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-06-28 06:27:58 +02:00
Rahul SteigerandHongsheng Liu 327e9dcaf2 [Feature] Spatially-sharded (SP) decode for the Wan VAE (#4620) 
Signed-off-by: Rahul Steiger <rsteiger@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-27 09:01:25 +08:00
MaciejBalaNV 47871d5e20 Updated Cosmos3 docstrings (#4727) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
 2026-06-27 06:39:42 +08:00
bmengkeandHongsheng Liu 329c98ff9d Wan2.2: Fix the bug of using cache-dit with ulysses in t2v and i2v (#3927) 
Signed-off-by: Mengkejiergeli Ba <mengkejiergeli.ba@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-25 15:15:59 +00:00
Honghan ZhuClaude Opus 4.7zhuhh97
 		5db89b41c4 [Core] hunyuan-image prefetch kv (#4448) 
Signed-off-by: z00806815 <zhuhonghan@huawei.com>
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Signed-off-by: dph97 <nenbaying@163.com>
Signed-off-by: zhh <zhh@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: zhuhh97 <zhuhh97@users.noreply.github.com>
 2026-06-25 21:31:49 +08:00
Wang fuyinzwhzzz0821Hongsheng Liu
 		8ddcb3621f [Config] Add structured VllmOmniConfig classes (#4425) 
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Signed-off-by: Wang  fuyin <wfy2003324@163.com>
Co-authored-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-25 17:48:20 +08:00