anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,228 Commits 235 Branches 31 Tags
44ea27c8094095bbffd88fa3befdfaa55ba4bc50
Commit Graph
570 Commits
Author SHA1 Message Date
Isotr0py 44ea27c809 fix pre-commit 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-23 06:22:17 +00:00
Isotr0py 0c82bb1315 Gate persistent DiT staging on decode-graph models 
ModelLevelOffloadBackend passed persistent_dit_staging=(device is CUDA) for
every model, so Qwen-Image 2.0/FLUX/WAN-style sequential offload kept DiT
device storage alive across swaps instead of freeing VRAM. Only retain
staging when a DiT actually captures weight pointers (enable_cuda_graph_decode);
other models keep plain move semantics. Add tests pinning both behaviors.
 2026-09-22 08:58:32 +00:00
Isotr0py 8e0695f362 Merge branch 'main' into qwen-image-2.1 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-09-22 10:11:12 +08:00
shihongzhi c11596c637 [Model] MammothModa2: enable Cache-DiT acceleration for the DiT stage (#7291) 
Signed-off-by: shihongzhi <shi65881583@gmail.com>
 2026-09-21 18:34:12 -07:00
Isotr0py 3e274a0024 Merge remote-tracking branch 'origin/main' into qwen-image-2.1 
# Conflicts:
#	tests/entrypoints/openai_api/test_image_server.py
#	vllm_omni/entrypoints/openai/api_server.py
 2026-09-22 01:23:45 +00:00
vOv d8d162d810 [Core][Diffusion] Add pause_generation(mode="keep") for diffusion stages (#7685) 
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
 2026-09-22 01:31:22 +08:00
wangyu 279b1b9687 [Bugfix] Isolate weekly CPU tests from inherited attention env and hf_api mocks (#7565) 
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: [Your Name] [Your Email]
 2026-09-21 15:55:00 +00:00
0z5a 2c2cffd2aa [Bugfix] Preserve NextStep rectangular latent dimensions (#7853) 
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
 2026-09-21 08:26:14 -07:00
tsinghua-code e5c0afc994 [Model] Enable online FP8 linears for LingBot World (#7549) 
Signed-off-by: tsinghua-code <zr-liu25@mails.tsinghua.edu.cn>
 2026-09-21 12:21:46 +00:00
Zhou TaichangandClaude Fable 5.1 5356357cf0 [LingBot World] Shard the streaming VAE decode across the Ulysses ranks (#7651) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-21 19:00:46 +08:00
wtz2333 8efd3c2f6d [Feature] Add experimental LingBot World last-step KV reuse (#7816) 
Signed-off-by: wtz2333 <2955110911@qq.com>
 2026-09-21 17:02:15 +08:00
Isotr0py 3d6a1c4d9a Address review: examples policy, SPDX headers, recipe docs, test coverage 
- Register QwenImage21Pipeline in model_extras _EXTRA_SPECS with an
  image-to-image prompt builder that forwards height/width
- Rename run_qwen_image_21_edit.sh to run_qwen_image_21.sh
- Fix SPDX-FileCopyrightText headers
- Recipe: document mixed-KV-phase admission, add head-vs-diffusers A/B
  comparison section (measurements pending)
- Add test_registry.py and test_pipeline.py (preprocess, prepare_latents
  ordering, mixed-phase _assemble_kv_cache, post-process); extend
  test_batch_compatibility.py
 2026-09-21 08:36:42 +00:00
WeiQing Chen 84977d9543 [Bugfix][MiniMax-H3] Fix Hopper keyframe and modulation precision (#7913) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-09-21 16:26:09 +08:00
Isotr0py 9174554e40 Merge remote-tracking branch 'origin/main' into qwen-image-2.1 
# Conflicts:
#	vllm_omni/diffusion/executor/multiproc_executor.py
#	vllm_omni/diffusion/offloader/sequential_backend.py
 2026-09-21 07:32:04 +00:00
Ding ZuhaoandCursor 154a1f25f5 [Bugfix] Honor the requested output canvas in BAGEL img2img (#7287) 
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-21 07:29:24 +00:00
Zhou TaichangandClaude Fable 5.1 86fcfe95f1 [LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-21 06:12:45 +00:00
DMAN d139c600c7 [Model] Add online FP8 support for Boogu-Image MLLM (#7342) 
Signed-off-by: Dmaner <2663515256@qq.com>
 2026-09-21 05:13:37 +00:00
Zeyu Huang | 黃澤宇 e36babd48f [Core][Diffusion] Camera interaction for diffusion streaming generation (LingBot World 2 as example) (#7198) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
 2026-09-20 16:19:41 +00:00
汪志鹏 139a47a578 [Model] Add MiniMax-H3 long-video latent continuation with driving audio (#7838) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-09-20 23:44:33 +08:00
DanaerLeeandzijianc2 16734bbdf3 [Bugfix] Route text-only chat as per-request comprehension in HunyuanImage3 AR sampler (#6111) 
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: zijianc2 <157244773+zijianc2@users.noreply.github.com>
 2026-09-20 15:23:53 +00:00
Wu JIAZHENAcerak01-fyamy-why-3459
 		102ba716bf [Feat] Add native Mooncake KV transfer from AR to DiT (#7166) 
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-20 14:44:55 +00:00
AliciaandHongsheng Liu d02681bf01 [Refactor][Diffusion] Move single-model layers into their model directories (#5908) 
Signed-off-by: congw729 <115451386+congw729@users.noreply.github.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-20 18:19:24 +08:00
Tianyu Guo 3ea9e60501 Fix diffusion API initialization (#7868) 
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
 2026-09-20 12:08:50 +08:00
xiaoyu-xyz 5a93ec1b4e [Model][Frontend] MiniMax-H3: Add latent-mask editing (#7465) 
Signed-off-by: xiaoyu <1259084489@qq.com>
 2026-09-20 03:54:44 +00:00
ooooooyeandWeiQing Chen b2b6c6c7a9 [Perf][MiniMax-H3] Cut video VAE encode/decode memory peaks for low-memory serving (#7241) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
 2026-09-20 10:56:54 +08:00
ooooooye a9abd563f9 [Bugfix][RAINFUSION_ATTN] Fix padding-mask rejection on packed [real, pad] layouts and reuse query tail as output padding (#7235) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-09-20 10:56:51 +08:00
Inesh Reddy Chappidi 51c715c7ef [Bugfix][Test] Assert stable-audio CPU offload savings on max_memory_allocated (#6826) 
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
Signed-off-by: Inesh Reddy Chappidi <ineshreddy249@gmail.com>
 2026-09-19 10:04:58 -07:00
NumberWan 23d8c83dab [Bugfix][Qwen-Image] Keep AutoRound W4A16 on CPU when offloading; Fixes #7555 (#7579) 
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
 2026-09-19 16:34:11 +00:00
akshatvishu 415005be22 [Model] Add circlestone-labs/Anima (#4083) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-09-19 16:16:38 +00:00
TaffyOfficialTaffyOfficialGao Han
 		698f716012 [Refactor] Reject unknown diffusion config fields (#5172) 
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Signed-off-by: zuiho <2324465096@qq.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-09-19 15:37:34 +00:00
Anjie HouClaude Opus 5Hongsheng Liu
 		ea84055507 [Refactor][Diffusion] Resolve distributed layerwise topology in the plan (#7326) 
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-19 19:05:18 +08:00
andyluo7 232dbc82f8 [CI/Build] Restrict ERNIE fused RoPE tests to NVIDIA CUDA (#7771) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-09-19 13:23:50 +08:00
Sunamy-why-3459Yueqian Lin
 		7b4fc7ce2e [Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134) 
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-18 13:29:18 -07:00
Isotr0py 5b540f55d3 Fix decode cuda graph for Qwen-Image-2.1 model-level cpu offload (#7801) 2026-09-19 00:10:53 +08:00
Tianyu Guo ab4cf24b3e Optimize Qwen-Image 2.1 attention and decode graph reuse (#7790) 
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
 2026-09-18 19:37:19 +08:00
holykie aa2fadac42 [Perf][Diffusion] Activate NPU/GPU matmul for LoRA delta computation when weights are on CPU (#7590) 
Signed-off-by: holykie <116775684+holykie@users.noreply.github.com>
 2026-09-18 16:51:23 +08:00
ooooooye 823af92347 [Bugfix][Ascend NPU][Diffusion] Load over-wide unquantized fallback weights straight into host memory under DLOFix/mxfp online offload after quant (#7009) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-09-18 07:36:48 +00:00
WeiQing Chen 5d3e6dc1b4 [Bugfix][MiniMax-H3] Use Hopper-safe modulation precision (#7693) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-09-18 15:16:45 +08:00
Tianyu Guo eb54a3186b Separate Qwen-Image 2.1 batches by condition image layout (#7764) 
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
 2026-09-18 13:47:35 +08:00
wtz2333 9fbc36ab2d [AR-Diffusion] Bound KV metadata for long rollouts (#7498) 
Signed-off-by: wtz2333 <2955110911@qq.com>
 2026-09-18 12:06:02 +08:00
andyluo7haic0Cursor
 		1c7476ec19 [CI/Build][ROCm] Stabilize shared AMD test lanes (#7706) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: haic0 <haic0@users.noreply.github.com>
Co-authored-by: haic0 <haic0@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-18 11:13:07 +08:00
Zhenqiang Xuandzqxu 242c3cddeb [Hardware][Ascend] Integrate MindIE dense and sparse quantized attention for Wan2.2 T2V (#7561) 
Signed-off-by: zqxu <xuzhenqiang3@huawei.com>
Co-authored-by: zqxu <xuzhenqiang3@huawei.com>
 2026-09-18 01:28:27 +00:00
Anjie Hou f8197e120f [5/N] Schedule chunk transfers as their own stage (#7406) 
Signed-off-by: specture724 <specture724@gmail.com>
 2026-09-18 09:27:56 +08:00
Alex Brooks 6bda549ac2 [Bugfix] Fix Parallel State Initialization For MoE + Diffusion (#7676) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-17 17:15:37 -06:00
dongbo910220 a6570b6814 [Diffusion] Fuse ERNIE-Image Q/K RoPE for eager execution (#7502) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2026-09-17 19:06:45 +00:00
BeatSeat 9cdc57d2e7 [Bugfix][MAGI-2] Fix layerwise offload OOM by pointing offload block attrs to 'block' (#7523) (#7540) 
Signed-off-by: BeatSeat <wendavid552@gmail.com>
 2026-09-17 19:02:08 +00:00
dongbo910220 97912de8d8 [Kernel] Fuse LongCat paired Q/K RoPE (#7500) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2026-09-18 02:27:57 +08:00
Anjie HouClaude Opus 5Hongsheng Liu
 		2ab5d1701a [4/N] Unify worker-side MP4 encoding and wire Wan into it (#7048) 
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-17 23:33:56 +08:00
Chenchao Xu d0755b5716 [Model] Add π0.5 (Pi0.5) VLA model support (#6950) 
Signed-off-by: chenchaox <chenchaox@nvidia.com>
 2026-09-17 05:18:51 -07:00
WeiQing Chen cb439f3e84 [Diffusion][Model] Add direct FastH3 8-Step V2 checkpoint loading (#7610) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-09-17 08:41:52 +00:00