Andy Zhou
c7fb59fd28
[Fix] Increase max wait time for server readiness to accommodate model loading ( #1089 )
...
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
2026-01-30 11:27:19 +08:00
amy-why-3459 and Rein Yang
dd518973de
[BugFix] Fix the accuracy issue of multimodal input. ( #1020 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
2026-01-29 19:30:11 +08:00
20e7310eb1
[Test]Delete skip mark for amd ci test and fix CI failure ( #927 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-29 16:21:24 +13:00
wangyu and wangyu31577
2cc4375df8
[Test] Add chunk e2e test case for CI ( #956 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-27 20:15:56 +08:00
34c9d8f2a2
[Test] Add precision test cases for Qwen3-Omni-30B-A3B-Instruct in CI ( #828 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-23 17:49:34 +13:00
334d306d9a
[Test] Add full test for Qwen3-Omni-30B-A3B-Instruct for image and audio single modal ( #827 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-21 13:04:46 +08:00
+13
776c3a794e
Dev/rebase 0.14.0 ( #847 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: root <root@hk01dgx039.cm.cluster >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: TangPeng <85704592@qq.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
Signed-off-by: Dinesh G <G.Dinesh@ibm.com >
Signed-off-by: gDINESH13 <dinesh13g@gmail.com >
Signed-off-by: root <root@hk01dgx028.cm.cluster >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: root <root@hk01dgx039.cm.cluster >
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com >
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-21 00:25:25 +08:00
wangyu and wangyu31577
4e23bfff9e
[Test] Add full test for Qwen3-Omni-30B-A3B-Instruct ( #720 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-16 21:16:43 +08:00
Jiangyun Zhu
aa689e6af0
[Core] add clean up method for diffusion engine ( #219 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-12-08 03:52:07 +00:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
Gaohan123
a04e945166
add precommit
2025-10-24 16:20:58 +08:00
hsliu
51d2570464
feat: Complete vLLM-omni implementation with conda environment setup
...
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities
This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
2025-09-25 09:10:54 +08:00
hsliu
154d9ca4ff
Initial vLLM-omni repository structure
...
- Add complete directory structure for multimodal and non-autoregressive processing
- Include AsyncLLM, OmniEngine, and DiffusionEngine modules
- Add processors, schedulers, executors, and output processors
- Add API interfaces for Higress, Gradio, and ComfyUI
- Add configuration management and CLI interface
- Add comprehensive test structure and documentation
- Add pyproject.toml with dependencies and project configuration
- Add examples and documentation structure
2025-09-11 14:32:51 +08:00