anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
323 Commits 235 Branches 31 Tags
51eefbfebc3e85dbe2ae2b5681c217617cef1e77
Commit Graph
38 Commits
Author SHA1 Message Date
Junhong Liu 51eefbfebc [BugFix] initial sampling_params_list when offline inference (#468) 
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
 2025-12-26 13:54:12 +08:00
dengyunyangandHongsheng Liu a500ca1f28 [Feature] logger refactor (#466) 
Signed-off-by: dengyunyang <584797741@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2025-12-26 08:42:06 +08:00
Ziming Huang 1a7dcdf65c [Feature] Support Qwen Omni online batch inference (#438) 
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
 2025-12-25 19:38:48 +08:00
Wonjae Leeandwonjae.lee0 341457a121 [Feature] Support standard OpenAI API sampling parameters for thinker stage. (max_tokens...) (#450) 
Signed-off-by: wonjae.lee0 <wonjae.lee0@navercorp.com>
Co-authored-by: wonjae.lee0 <wonjae.lee0@navercorp.com>
 2025-12-24 20:39:01 +08:00
Yuanheng Zhao edbd610060 [RFC] Clean and refactor TeaCache registry (#416) 
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
 2025-12-23 18:21:23 +08:00
Doug Smith 74c142460d DALL-E compatible image generation endpoint (#292) 
Signed-off-by: dougbtv <dosmith@redhat.com>
 2025-12-23 09:05:37 +08:00
Didan DengandJiangyun Zhu ee2b78e826 [Diffusion][Bug-Fix]: Fix Ulysses SP Accurary Error (#377) 
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2025-12-22 17:48:39 +08:00
Canlin Guo 97a5860681 [Security][Feature] Use Msgpack in OmniSerializer instead of pickle (#310) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2025-12-22 13:21:16 +13:00
Jiangyun Zhu a7fe4fba4e [refactor] teacache refactor (#395) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2025-12-22 06:49:04 +08:00
TJianandHongxia Yang 13584fd98e [ROCm] [CI] Add ROCm Dockerfile and AMD CI (vllm v0.12.0) (#280) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
 2025-12-21 11:51:37 +08:00
dsinghviandHongsheng Liu 4586efe651 [Model] Ovis Image Model Addition (#263) 
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2025-12-19 20:05:34 +08:00
rein yang c591ea124f [Bugfix] fix GPU VRAM calculation problem (#328) 
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
 2025-12-19 19:21:33 +08:00
WeiQing Chen 628c0a9217 [Entrypoints] Support Qwen-Image-Edit 2509 online serving & update doc (#368) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-12-19 16:50:32 +08:00
Zhou TaichangRein YangIsotr0py
 		8939eb835d [Rebase] Rebase to vllm 0.12.0 (#335) 
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-12-19 16:42:02 +08:00
Isotr0py cf8d297af0 [Chore]: Clean up pyproject.toml and cache-dit backend (#351) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-12-18 04:03:53 +00:00
Gao Han 8722c6374c [Feature] Support output modalities control per request (#298) 
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
 2025-12-17 17:19:56 +08:00
Canlin Guo 2b6d8f17ba [NPU][CI] Add the CI workflow on NPU (#231) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2025-12-17 17:07:12 +08:00
Didan Deng 85f0c1177f [Diffusion]: Diffusion Ulysses-Sequence-Parallelism support (#189) 
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2025-12-17 15:41:31 +08:00
SamitandJiangyun Zhu 2b4a9fe729 [Diffusion] Add cache-dit and unify diffusion cache backend interface (#250) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2025-12-15 15:10:45 +08:00
Alicia c32f52fcc0 [CI] Adjust folder (#300) 
Signed-off-by: Alicia Wang <115451386+congw729@users.noreply.github.com>
 2025-12-12 09:19:24 +00:00
rein yang 50dcc5086b [CI] Qwen3-Omni online test (#257) 
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
 2025-12-12 14:25:52 +08:00
Yueqian Lin 4128d63c51 [Model] Add Wan2.2 text-to-video support (#202) 
Signed-off-by: linyueqian <linyueqian@outlook.com>
 2025-12-11 10:38:05 +08:00
WeiQing Chen 3f699a7b4d [Misc] fix stage config describe and yaml format (#265) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-12-11 13:34:52 +13:00
NATURE f995211da0 [Feature] Omni Connector + ray supported (#215) 
Signed-off-by: wzliu <wzliu@connect.hku.hk>
 2025-12-10 20:15:03 +08:00
WeiQing Chen 9a7f7b7de5 [Bugfix]multi-GPU tp scenarios, devices: "0,1" uses physical IDs instead of logical IDs (#253) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-12-09 21:04:30 +08:00
rein yang baf1086d55 [CI] Add Qwen3-omni offline UT (#216) 
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
 2025-12-08 18:11:39 +08:00
Jiangyun Zhu aa689e6af0 [Core] add clean up method for diffusion engine (#219) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2025-12-08 03:52:07 +00:00
Gao Han 02b1b36c6d [Bugfix] Fix ci bug for qwen2.5-omni (#230) 
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
 2025-12-08 02:43:48 +08:00
Canlin GuoIsotr0pyGao Han
 		f75c21bcd0 [E2E] Add Qwen2.5-Omni model test with OmniRunner (#168) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Gao Han <gaohan19@huawei.com>
 2025-12-06 06:20:26 +00:00
Jiangyun ZhuandKevin H. Luu 630cbe1ee6 [CI] add diffusion ci (#174) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2025-12-04 15:23:22 +00:00
Alicia a33bbcedea [Fix] Resolve comments & update vLLM-Omni name usages. (#122) 
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
 2025-12-01 08:05:24 +08:00
Alicia 3427fb4774 [Feat] Rename AsyncOmniLLM -> AsyncOmni (#103) 
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
 2025-11-30 22:26:33 +08:00
Jiangyun Zhu e1bec308a3 [CI] Fix ci (#110) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2025-11-30 15:09:45 +08:00
Roger WangandWANG Cong 1ab88823d4 Simple test from PR#88 on Buildkite (#93) 
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: WANG Cong <115451386+congw729@users.noreply.github.com>
 2025-11-28 13:05:07 -08:00
Gaohan123 6cf73c4e80 Remove unused files and fix some bugs 2025-10-25 18:02:11 +08:00
Gaohan123 a04e945166 add precommit 2025-10-24 16:20:58 +08:00
hsliu 51d2570464 feat: Complete vLLM-omni implementation with conda environment setup 
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities

This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
 2025-09-25 09:10:54 +08:00
hsliu 154d9ca4ff Initial vLLM-omni repository structure 
- Add complete directory structure for multimodal and non-autoregressive processing
- Include AsyncLLM, OmniEngine, and DiffusionEngine modules
- Add processors, schedulers, executors, and output processors
- Add API interfaces for Higress, Gradio, and ComfyUI
- Add configuration management and CLI interface
- Add comprehensive test structure and documentation
- Add pyproject.toml with dependencies and project configuration
- Add examples and documentation structure
 2025-09-11 14:32:51 +08:00