 tzhouam
|
b8f736c5a9
|
Remove obsolete image and YAML configuration files for Qwen2.5 and Qwen3 models from the e2e stage configurations.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-20 02:11:18 +00:00 |
|
|
tzhouam
|
3c52432100
|
Merge branch 'main' into dev/vllm-align
|
2026-03-20 01:38:43 +00:00 |
|
|
Yuanheng Zhao
|
6ac7ba692d
|
[Feat] Support T5 Tensor Parallelism (#1881)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-03-20 08:49:01 +08:00 |
|
|
Chen-Yo Sun
|
e9fe78e28c
|
[Model] Add Voxtral TTS model (#1803)
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
|
2026-03-19 16:02:11 -04:00 |
|
|
|
b766c4702c
|
Int8 Quantization Support for DiT (Z-Image & Qwen-Image) (#1470)
Signed-off-by: juboyu <767868009@qq.com>
Signed-off-by: JuboYu <767868009@qq.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-03-19 22:58:29 +08:00 |
|
|
TJian
|
0239057cba
|
[CI] [ROCm] Setup test-ready.yml and test-merge.yml (#2017)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-03-19 14:26:31 +00:00 |
|
|
tzhouam
|
367ce6328c
|
Merge remote-tracking branch 'remotes/origin/main' into dev/vllm-align
|
2026-03-19 09:38:17 +00:00 |
|
|
Ziming Huang
|
89fff09628
|
[Fix] Fix slow hasattr in CUDAGraphWrapper.__getattr__ (#1982)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2026-03-19 17:10:08 +08:00 |
|
|
tzhouam
|
37e055ed9e
|
Merge remote-tracking branch 'remotes/origin/main' into dev/vllm-align
|
2026-03-19 08:49:35 +00:00 |
|
|
汪志鹏
|
81793f1918
|
[CI] Split BAGEL tests into dummy/real weight tiers (L2/L3) (#1998)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-19 15:32:48 +08:00 |
|
|
tzhouam
|
22b6703773
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-19 05:16:40 +00:00 |
|
|
NumberWan
|
ae92ef5f00
|
[Test] L4 complete diffusion feature test for Bagel models (#1938)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-03-19 11:53:20 +08:00 |
|
|
tzhouam
|
342a209924
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-19 02:06:26 +00:00 |
|
|
|
fc5e8f825e
|
[Optim][Qwen3TTS] big boost model throughput+latency high concurrency (#1852)
Signed-off-by: pablo <pablo@agigo.ai>
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: pablo <pablo@agigo.ai>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-18 12:22:05 -04:00 |
|
|
汪志鹏
|
61e170c69a
|
[Feature]: Remove some useless hf_overrides in yaml (#1898)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-18 19:46:44 +08:00 |
|
|
Y. FisherandCanlin Guo
|
f52b51533a
|
[Feature] Add cache-dit support for HunyuanImage3 (#1848)
Signed-off-by: KexiongYu <yukexiong1@huawei.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-03-18 10:18:27 +00:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
Yueqian Lin
|
fe786f1a19
|
Fix Base voice clone streaming quality and stop-token crash (#1945)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-18 06:54:12 +08:00 |
|
|
Taichang Zhou
|
8a31e7865d
|
Increase timeout for Diffusion Model Test and Diffusion Images API LoRA E2E in Buildkite configurations to 30 minutes. Also, introduce a new timeout constant for diffusion initialization in relevant test files to enhance stability during testing. Update OmniServer initialization to utilize the new timeout settings.
|
2026-03-17 23:43:46 +08:00 |
|
|
tzhouam
|
004c60a031
|
Refactor shutdown and cleanup logic in OmniRunner and OmniStage to improve process termination and resource management. The changes ensure that stage workers are stopped before closing queues, preventing potential orphaned subprocesses. Additionally, enhanced error handling during process termination provides clearer logging for failed shutdown attempts. This update aims to increase the reliability and stability of the shutdown process across the application.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 09:33:28 +00:00 |
|
|
tzhouam
|
722ad6bbae
|
rebase: align vllm-omni with vLLM 0a0a1a198be8
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 03:26:42 +00:00 |
|
|
tzhouam
|
57ac7eb155
|
rebase: align vllm-omni with vLLM 2754231ba3a7
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 09:28:56 +00:00 |
|
|
tzhouam
|
3a508d7b7a
|
rebase: align vllm-omni with vLLM e9163b536e72
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 02:32:39 +00:00 |
|
|
tzhouam
|
f137a1e3ad
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-16 01:49:46 +00:00 |
|
|
汪志鹏
|
284575ab82
|
[CI]: Add/Fix bagel e2e online/offline test (#1895)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-15 18:27:07 +08:00 |
|
|
|
5377619c0b
|
fix: propagate parallel_config through create_default_diffusion (#1878)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-14 17:07:13 +08:00 |
|
|
|
dc72aede40
|
[CI] add multimodal processing correctness tests for Omni models (#1445)
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Ding Zuhao <e1583181@u.nus.edu>
|
2026-03-14 14:15:25 +08:00 |
|
|
Daniel Huang
|
c107f0b336
|
Buildkite hardware ci xpu test (#1340)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-14 11:24:05 +08:00 |
|
|
Alex Brooks
|
e17130090c
|
[BugFix] Fix Max Rank Handling in LoRA (#1397)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-03-14 02:42:54 +00:00 |
|
|
tzhouam
|
97899c6c98
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-13 19:03:57 +00:00 |
|
|
|
92f771d455
|
[Frontend] Rewrite video API for async job lifecycle (#1665)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Gao Han <gaohan19@huawei.com>
|
2026-03-13 17:11:06 +08:00 |
|
|
汪志鹏
|
e0b71056ba
|
[BugFix]: Fix bagel online inference bug (#1804)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-13 08:58:44 +00:00 |
|
|
Gao Han
|
717dbee5a6
|
[CI failed] Disable test for zimage tensor parallelism (#1870)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-03-13 14:52:48 +08:00 |
|
|
tzhouam
|
d3db476f2d
|
Merge branch 'main' into dev/vllm-align
|
2026-03-13 06:51:22 +00:00 |
|
|
Gao Han
|
36c6cb9634
|
[CI failure] Comment out test_zimage_vae_patch_parallel_tp2 (#1856)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-03-13 01:00:16 +08:00 |
|
|
tzhouam
|
72cb4f661b
|
Adjust GPU memory utilization and device settings in qwen2_5_omni_ci.yaml for improved performance
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-12 13:57:52 +00:00 |
|
|
Zeyu Huang | 黃澤宇andHongsheng Liu
|
21e621f84c
|
[Test] Reduce SP & Offloading test cases for L2 (#1839)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-12 13:32:43 +00:00 |
|
|
SYLAR
|
c8c60e1970
|
[Config Refactor][1/2] Model Pipeline Configuration System (#1115)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-12 21:09:34 +08:00 |
|
|
|
28dd1a699d
|
[Model] Extend NPU support for HunyuanImage3 Diffusion Model (#1689)
Signed-off-by: ElleElleWu <1608928702@qq.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: skf1999 <13234016272@163.com>
Co-authored-by: Just-it <1161406585@qq.com>
Co-authored-by: Semmer2 <semmer@live.cn>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-12 20:49:17 +08:00 |
|
|
rongfu.leng
|
7c5159037f
|
[Feat] add wav response_format when stream is true in /v1/audio/speec… (#1819)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2026-03-12 17:45:13 +08:00 |
|
|
Vensen
|
3306fa6611
|
[Feat][Diffusion]: Implement Component-Level VRAM Quota and Resource Domain Isolation (#1582)
Signed-off-by: vensen <vensenmu@gmail.com>
|
2026-03-12 12:17:18 +08:00 |
|
|
|
5d28b6a40c
|
[Feat][Qwen3-TTS] Support streaming audio output for websocket (#1719)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
|
2026-03-11 23:48:41 -04:00 |
|
|
Daniel Huang
|
ac17431745
|
[Enhancement] Patch OmniStage.try_collect() with _proc alive checks (#1560)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-12 10:40:42 +08:00 |
|
|
Yueqian Lin
|
e1efcb7560
|
Fix duplicate get_supported_tasks definition in async_omni.py (#1825)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-11 19:43:37 -04:00 |
|
|
wangyu
|
da4a077155
|
[Test] Skip the qwen3-omni relevant validation for a known issue 1367. (#1812)
Signed-off-by: yenuo26 <410167048@qq.com>
|
2026-03-11 15:00:13 -04:00 |
|
|
Yueqian Lin
|
f144f5effe
|
[Test] Add Qwen3-TTS nightly performance benchmark (#1700)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:07:47 +08:00 |
|
|
Yueqian Lin
|
a6b5519616
|
[Bugfix] Report supported tasks for omni models to skip unnecessary chat init (#1645)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:06:20 +08:00 |
|
|
Didan Deng
|
af9784c03f
|
[Bugfix] Adjust Z-Image Tensor Parallelism Diff Threshold (#1808)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-11 20:30:54 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
74eedd3ef1
|
[Frontend] ComfyUI video & LoRA support (#1596)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-03-11 10:22:45 +00:00 |
|
|
Zeyu Huang | 黃澤宇andHongsheng Liu
|
a19098233b
|
[Test] L4 complete diffusion feature test for Qwen-Image-Edit models (#1682)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-11 18:10:06 +08:00 |
|