tzhouam
342a209924
Merge remote-tracking branch 'origin/main' into dev/vllm-align
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-19 02:06:26 +00:00
3158e9d28f
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring ( #1908 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com >
Co-authored-by: wuhang <whlbx@hotmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-03-18 17:33:53 +08:00
tzhouam
004c60a031
Refactor shutdown and cleanup logic in OmniRunner and OmniStage to improve process termination and resource management. The changes ensure that stage workers are stopped before closing queues, preventing potential orphaned subprocesses. Additionally, enhanced error handling during process termination provides clearer logging for failed shutdown attempts. This update aims to increase the reliability and stability of the shutdown process across the application.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 09:33:28 +00:00
Zeyu Huang | 黃澤宇 and Hongsheng Liu
a19098233b
[Test] L4 complete diffusion feature test for Qwen-Image-Edit models ( #1682 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-11 18:10:06 +08:00
Daniel Huang
745ef312a7
[Enhancement][pytest] Check for process running during start server ( #1559 )
...
Signed-off-by: Daniel Huang <daniel1.huang@intel.com >
2026-03-10 15:44:54 +08:00
wangyu
5628d41242
[Test] Solving the Issue of Whisper Model's GPU Memory Not Being Successfully Cleared and the Occasional Accuracy Problem of the Qwen3-omni Model Test ( #1744 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-03-09 21:52:56 +08:00
wangyu
1ae2e1e4c4
[Test] Reduce Perf test case and fix modify stage config ( #1449 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-26 14:20:57 +08:00
wangyu
a42b7487b0
[Test] Fix expansion and example test case for qwen3-omni ( #1358 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-15 00:43:38 +13:00
wangyu
f4867ec175
[Test] Add Omni Model Performance Benchmark Test ( #1321 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-02-12 23:11:57 +08:00
20a8fe1dcc
[Test] L2 & L3 Test Case Stratification Design for Omni Model ( #1272 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-12 09:56:35 +08:00
b81e0a8abf
[Test] Add example test cases for omni online ( #1086 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: yenuo26 <410167048@qq.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-09 20:08:46 +08:00
wangyu and wangyu31577
398ae95b96
[CI] Add CI branch coverage calculation, fix statement coverage results and add log before test for buildkite log group ( #1120 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-02-05 10:54:40 +08:00
Andy Zhou
c7fb59fd28
[Fix] Increase max wait time for server readiness to accommodate model loading ( #1089 )
...
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
2026-01-30 11:27:19 +08:00
amy-why-3459 and Rein Yang
dd518973de
[BugFix] Fix the accuracy issue of multimodal input. ( #1020 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
2026-01-29 19:30:11 +08:00
20e7310eb1
[Test]Delete skip mark for amd ci test and fix CI failure ( #927 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-29 16:21:24 +13:00
wangyu and wangyu31577
2cc4375df8
[Test] Add chunk e2e test case for CI ( #956 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-27 20:15:56 +08:00
34c9d8f2a2
[Test] Add precision test cases for Qwen3-Omni-30B-A3B-Instruct in CI ( #828 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-23 17:49:34 +13:00
334d306d9a
[Test] Add full test for Qwen3-Omni-30B-A3B-Instruct for image and audio single modal ( #827 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-21 13:04:46 +08:00
+13
776c3a794e
Dev/rebase 0.14.0 ( #847 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: root <root@hk01dgx039.cm.cluster >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: TangPeng <85704592@qq.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
Signed-off-by: Dinesh G <G.Dinesh@ibm.com >
Signed-off-by: gDINESH13 <dinesh13g@gmail.com >
Signed-off-by: root <root@hk01dgx028.cm.cluster >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: root <root@hk01dgx039.cm.cluster >
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com >
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-21 00:25:25 +08:00
wangyu and wangyu31577
4e23bfff9e
[Test] Add full test for Qwen3-Omni-30B-A3B-Instruct ( #720 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-16 21:16:43 +08:00
Jiangyun Zhu
aa689e6af0
[Core] add clean up method for diffusion engine ( #219 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-12-08 03:52:07 +00:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
Gaohan123
a04e945166
add precommit
2025-10-24 16:20:58 +08:00
hsliu
51d2570464
feat: Complete vLLM-omni implementation with conda environment setup
...
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities
This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
2025-09-25 09:10:54 +08:00
hsliu
154d9ca4ff
Initial vLLM-omni repository structure
...
- Add complete directory structure for multimodal and non-autoregressive processing
- Include AsyncLLM, OmniEngine, and DiffusionEngine modules
- Add processors, schedulers, executors, and output processors
- Add API interfaces for Higress, Gradio, and ComfyUI
- Add configuration management and CLI interface
- Add comprehensive test structure and documentation
- Add pyproject.toml with dependencies and project configuration
- Add examples and documentation structure
2025-09-11 14:32:51 +08:00
tzhouam