anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,626 Commits 235 Branches 31 Tags
10906e3a6db947290581b88dc4b6f35bd2a26b41
Commit Graph
57 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Samit 136cb27b05 [Bugfix] Fix lost async diffusion outputs in request-level batching (#6023) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-08-15 18:27:51 +08:00
Samit 8a5bf2fb3f [doc]: Update latest news section for verl-omni release (#6187) 
Signed-off-by: Samit <285365963@qq.com>
 2026-08-14 12:04:15 +08:00
Samit a5db2d839a [Diffusion] Improve HuggingFace hub kernel loading in flash_attn_hub (#4977) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-07-09 12:10:10 +08:00
Samit b96bc5ac87 Support HuggingFace kernels package for native diffusion attention backends (#4926) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-07-08 14:34:36 +08:00
SamitandCursor 31c9c751fc [Bugfix] Fix LoRA arguments passing in offline text-to-image script (#4936) 
Signed-off-by: SamitHuang <285365963@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-07 09:32:32 +00:00
Samit 5f5b77aa9c [BugFix][Qwen-Image] align txt_seq_lens RoPE width with padded embeds (#4474) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-06-16 19:09:25 +08:00
Samit f44f3ef9f7 [platform] fix: set UnspecifiedOmniPlatform device_type to cpu (#4357) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-06-12 08:40:00 +00:00
Samit 6ddaf6188d Fix README.md typo (#4292) 2026-06-09 18:08:09 +08:00
Samit 8e937400dc Fix OmniDiffusionConfig master_port selection for parallel launches (#3803) 2026-05-22 11:12:29 +08:00
Samit 083b5e363f [Diffusion] Support LoRA in step-wise execution (#3639) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-05-20 22:26:18 +08:00
Samit 569899e8d9 [Docs] Add performance profiling step to add-diffusion-model skill (#3196) 
Signed-off-by: SamitHuang <285365963@qq.com>
 2026-04-28 10:21:11 +08:00
Samit 61a3cbdff5 [Perf] Eliminate Hop 3 IPC overhead for single-stage diffusion via inline execution (#2736) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-04-15 11:46:06 +08:00
Samit 644edac0b6 [Perf] Optimize MP4 encoding latency in video generation (#2735) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-04-14 14:20:38 +08:00
Samit d1fef41266 [Doc] Add LTX-2 online serving deployment recipes with optimization benchmarks (#1971) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-04-11 16:50:03 +08:00
Samit 956f53b278 [Refactor] Use trajectory_* fields for Qwen-Image structured RL outputs (#2513) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-04-09 03:06:40 -07:00
Samit a7bf4050de [Docs] Add multi-thread weight loading documentation (#2445) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-04-09 15:54:23 +08:00
Samit 7b965a7b6c [Feat][Benchmark] Add synchronous video generation endpoint POST /v1/videos/sync for benchmark test (#2049) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-04-01 10:47:33 +08:00
Samit 61e0ec517d [Test] L4 complete diffusion feature test for Qwen-Image models (#1869) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-03-27 14:03:50 +08:00
SamitZeyu Huang | 黃澤宇gcanlin
 		d96d63cb7f [Doc] Improve diffusion generation parameter docs for online serving (#2051) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
 2026-03-26 15:12:16 +00:00
SamitandDidan Deng 9ead0d890d [Enhancement] Add force_refresh support for GLM-Image for cache-dit 1.3.0 upgrade (#1858) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-03-24 14:32:18 +08:00
Samit 4c2293743b [Docs] Add Wan2.1-T2V as supported video generation models (#1920) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-03-20 14:14:20 +08:00
SamitandHongsheng Liu 5699fe7a96 [Bugfix] Fix config misalignment between offline and online diffusion inference (Wan2.2, Qwen-Image series) (#1979) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-03-19 16:00:26 +08:00
Samit 4dbaa74f2b [Enhancement] Upgrade cache-dit from 1.2.0 to 1.3.0 (#1834) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-03-12 15:39:06 +08:00
Samit b313279af7 [skip ci][Docs] doc fix for example snippets (#1811) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-03-11 17:32:12 +08:00
Samit 155856ff30 [Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-03-10 00:03:51 +13:00
Samit 22a51a7cdb [Feature][Wan2.2] Speed up diffusion model startup by multi-thread weight loading (#1504) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-03-02 14:53:25 +00:00
SamitandFlora Feng 9c00852d85 [Feature] Support Wan2.2 T2V and I2V Online Serving with OpenAI /v1/videos API (#1073) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-02-12 14:28:32 +08:00
Samit c0beebbfe3 [Feature] Support cache-dit for Wan 2.2 inference (#1021) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-01-28 20:07:50 +08:00
SamitandHongsheng Liu 978a290d6e [Bugfix] Fix diffusion pipeline CFG (guidance_scale parsing failure bug) (#922) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-26 05:09:03 +00:00
SamitHongsheng LiuJiangyun Zhu
 		5d9918fa67 [Misc] Fix error log for the diffusion stage timeout (#915) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2026-01-23 15:16:40 +08:00
Samit f266b04534 [Bugfix] Fix video saving bug under certain fps (#893) 
Signed-off-by: SamitHuang <285365963@qq.com>
 2026-01-22 18:25:47 +13:00
Samit 2d5faf3634 [Bugfix] Fix generation artifacts of Qwen-Image-Edit-2511 and update pipeline DiT param parsing (#776) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-01-15 11:18:28 +08:00
Samit b7e63e07d7 [Docs] Update diffusion_acceleration.md (#659) 
Signed-off-by: SamitHuang <285365963@qq.com>
 2026-01-06 07:06:03 +00:00
Samit 535b1a93f5 [Docs] Fix diffusion module design doc (#645) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-01-05 19:07:35 +08:00
SamitandHongsheng Liu 4cc28275f9 [Docs] Add diffusion module design doc (#592) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-05 14:33:18 +08:00
SamitandHongsheng Liu 61ac92a84d [Docs] Fix diffusion acceleration docs (#591) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-04 07:11:43 +00:00
Samit 667f6cf25d [Misc] Fix Qwen-Omni multiple prompt running scripts (#579) 
Signed-off-by: samithuang <285365963@qq.com>
 2026-01-02 23:50:54 +13:00
Samit 2d42bdcc40 [Misc] Add Qwen-Image-Edit-2511 running script (#440) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-24 04:26:16 +13:00
Samit 96e4690013 [Bugfix] Fix image size logging bug for multiple image input (#384) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-20 06:49:57 +08:00
Samit 094de95548 [Misc] Update qwen-omni gradio demo to use api server (#378) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-19 18:09:43 +08:00
Samit eb41000851 [Model] Support Qwen-Image-Edit 2509 ( multi-image input edit) (#330) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-18 10:16:32 +00:00
Samit 4f25803289 [Model] Support Qwen-Image-Edit 2511 (#321) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-16 18:09:16 +08:00
Samit 06c2b7f6e4 [Misc] Fix docs and update image edit example with cache-dit (#318) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-15 13:43:28 +00:00
SamitandJiangyun Zhu 2b4a9fe729 [Diffusion] Add cache-dit and unify diffusion cache backend interface (#250) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2025-12-15 15:10:45 +08:00
Samit e8ea4784c6 [Model] Add Qwen-Image-Edit (#196) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2025-12-08 08:19:27 +00:00
SamitandHongsheng Liu 4ac3e6e7d0 [Docs] Add basic usage examples for diffusion (#222) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2025-12-08 00:00:25 -08:00
Samit 5a0d7882c5 [Misc] Qwen-Omni support offline inference with local files (#167) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-02 19:05:45 +08:00
Samit 98d94e0e3d [Bugfix] Fix Qwen3-Omni gradio audio input bug (#147) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-01 13:52:31 +00:00
Samit 1a23d70a97 [Misc][WIP] Support qwen-omni online inference with local video/audio/image path (#131) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-12-01 00:30:22 -08:00
Samit f378f80430 [Bugfix] Fix redundant shm broadcast warnings in diffusion workers (#133) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-30 23:17:56 -08:00
Samit 04987ffa7a [Bugfix] Fix Qwen-omni Online Inference Bug caused by check_stop and long sequence (#112) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-30 23:23:45 +08:00
Samit 3ea7fd280b [Feature] Support Gradio Demo for Qwen3-Omni (#116) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-30 20:44:04 +08:00
Samit f77e44d5bf [Docs] Add qwen image missing doc in user guide (#111) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-30 17:46:39 +08:00
Samit 1f1be495b0 [Diffusion] Support Multi-image Generation and Add Web UI Demo for QwenImage (#97) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
 2025-11-29 20:19:50 +08:00
Samit befc7fdfd7 Update gradio docs (#95) 
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-28 15:06:33 +08:00
Samit b2d845742a [Feature] Add Gradio Demo for Qwen2.5Omni (#60) 
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
 2025-11-26 09:23:46 +08:00
Samit 8cafb4294d [Docs] Setup Documentation System and Re-organize Dependencies (#49) 
Signed-off-by: SamitHuang <285365963@qq.com>
 2025-11-15 21:45:43 +08:00