tzhouam
034d579d77
Update vLLM precompiled wheel version and refactor various components for improved functionality and error handling. Changes include modifying the get_name method in DiffusionQuantizationConfig to use class-level attributes, enhancing metadata handling in StageEngineCoreClient, and adjusting the AsyncOmni class constructor for better parameter management. Additionally, improved error handling in omni_snapshot_download and optimized initial chunk size computation in talker2code2wav_async_chunk for dynamic load adaptation.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-19 05:14:34 +00:00
tzhouam
35b3dd638a
Refactor Dockerfile.ci to install vLLM from a dynamically retrieved precompiled wheel URL, improving the installation process by ensuring compatibility with PEP 440 local version identifiers. This change enhances the reliability of vLLM installations. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 06:08:59 +00:00
tzhouam
83effe39ac
Update Dockerfile.ci to include an additional extra index URL for pip installation, enhancing package resolution for vLLM. This change ensures compatibility with both precompiled wheels and packages from PyPI.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 04:07:50 +00:00
tzhouam
b7a36d16d4
Merge branch 'dev/vllm-align' of https://github.com/vllm-project/vllm-omni into dev/vllm-align
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 03:54:31 +00:00
tzhouam
722ad6bbae
rebase: align vllm-omni with vLLM 0a0a1a198be8
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 03:26:42 +00:00
Zhou Taichang
ac937b82e6
Refactor Dockerfile to install vLLM from source
...
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
2026-03-17 11:08:45 +08:00
tzhouam
b0e36f9f5d
Update Dockerfile.ci to force reinstall vLLM from a precompiled wheel, ensuring the latest version is used. This change enhances the installation process by guaranteeing that any existing installations are replaced. Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 02:04:51 +00:00
tzhouam
83b05ce3e4
Refactor Dockerfile.ci to install vLLM using a precompiled wheel from a specified commit, replacing the previous source installation method. This update simplifies the installation process and ensures correct dependency management. Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-17 01:35:12 +00:00
Zhou Taichang
22a2bd3406
Upgrade flashinfer-cubin and flashinfer-jit-cache versions
...
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
2026-03-16 19:31:03 +08:00
tzhouam
8e81e60d32
Refactor Dockerfile.ci to install vLLM from source using precompiled artifacts at a specified commit. This change replaces the previous wheel installation method and ensures the correct versioning of dependencies. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 10:01:18 +00:00
tzhouam
de6bcc734c
Update Dockerfile.ci to use a new vllm wheel URL and refactor MooncakeConnector import logic in monkey_patch.py for improved compatibility. Adjust OpenAIServingChat to call the harmony request method from the correct context.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 08:33:28 +00:00
tzhouam
3a508d7b7a
rebase: align vllm-omni with vLLM e9163b536e72
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 02:32:39 +00:00
tzhouam
08a2673c66
rebase: align vllm-omni with vLLM 84e436ed1c94
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-11 07:29:52 +00:00
tzhouam
a9862f17f3
Revert "Refactor Dockerfile.ci to consolidate package installation commands into a single RUN statement, improving readability and efficiency of the CI environment setup."
...
This reverts commit 1c0a71e30dtzhouam@connect.ust.hk >
2026-03-10 09:41:45 +00:00
tzhouam
1c0a71e30d
Refactor Dockerfile.ci to consolidate package installation commands into a single RUN statement, improving readability and efficiency of the CI environment setup.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-10 09:13:24 +00:00
tzhouam
cf0a7a5475
Update Dockerfile.ci to install additional dependencies for flashinfer and numpy, and create a symlink for python3. This enhances the CI environment setup.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-10 08:05:28 +00:00
tzhouam
3630bdfaa7
Update Dockerfile.ci to install vLLM from a new commit and simplify worker_type retrieval in omni_stage.py. Removed unnecessary dependency installations for flashinfer and numpy.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-10 01:55:12 +00:00
tzhouam
dd0c893e79
Align dev/vllm-align with upstream vLLM changes
...
- Update Dockerfile.ci to install vLLM from specific commit wheel,
add flashinfer/cublas/numpy dependencies
- Fix worker_type leak in omni_stage by using pop instead of get
Made-with: Cursor
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-10 01:46:53 +00:00
wangyu
5628d41242
[Test] Solving the Issue of Whisper Model's GPU Memory Not Being Successfully Cleared and the Occasional Accuracy Problem of the Qwen3-omni Model Test ( #1744 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-03-09 21:52:56 +08:00
89b527e533
Dev/rebase v0170 ( #1639 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
2026-03-09 17:29:38 +08:00
TJian
7ac8d613f6
[Version] Auto generate version using setuptool_scm ( #1224 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-02-27 14:34:27 +08:00
Zhou Taichang
986b356077
[CI] Update Dockerfile for vllm-omni CI image and remove obsolete dep… ( #1491 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-26 14:36:03 +08:00
wangyu
1ae2e1e4c4
[Test] Reduce Perf test case and fix modify stage config ( #1449 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-26 14:20:57 +08:00
75770c9309
[Rebase] Rebase to vllm v0.16.0 ( #1357 )
...
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com >
Co-authored-by: youkaichao <youkaichao@gmail.com >
2026-02-13 18:05:07 +08:00
Yueqian Lin
f55ce9c793
[Test] Add e2e tests for Qwen3-TTS speech endpoint ( #1206 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-02-10 16:33:39 +08:00
Zhou Taichang
7fcbaa794c
[Debug] Clear Dockerfile.ci to accelerate build image ( #1172 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-03 13:43:45 +08:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
+13
776c3a794e
Dev/rebase 0.14.0 ( #847 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: root <root@hk01dgx039.cm.cluster >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: TangPeng <85704592@qq.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
Signed-off-by: Dinesh G <G.Dinesh@ibm.com >
Signed-off-by: gDINESH13 <dinesh13g@gmail.com >
Signed-off-by: root <root@hk01dgx028.cm.cluster >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: root <root@hk01dgx039.cm.cluster >
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com >
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
2026-01-21 00:25:25 +08:00
wangyu and wangyu31577
4e23bfff9e
[Test] Add full test for Qwen3-Omni-30B-A3B-Instruct ( #720 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
2026-01-16 21:16:43 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
Jiangyun Zhu and Kevin H. Luu
630cbe1ee6
[CI] add diffusion ci ( #174 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
Co-authored-by: Kevin H. Luu <khluu000@gmail.com >
2025-12-04 15:23:22 +00:00
tzhouam