 tzhouam
|
342a209924
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-19 02:06:26 +00:00 |
|
|
|
fc5e8f825e
|
[Optim][Qwen3TTS] big boost model throughput+latency high concurrency (#1852)
Signed-off-by: pablo <pablo@agigo.ai>
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: pablo <pablo@agigo.ai>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-18 12:22:05 -04:00 |
|
|
汪志鹏
|
61e170c69a
|
[Feature]: Remove some useless hf_overrides in yaml (#1898)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-18 19:46:44 +08:00 |
|
|
Y. FisherandCanlin Guo
|
f52b51533a
|
[Feature] Add cache-dit support for HunyuanImage3 (#1848)
Signed-off-by: KexiongYu <yukexiong1@huawei.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-03-18 10:18:27 +00:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
Yueqian Lin
|
fe786f1a19
|
Fix Base voice clone streaming quality and stop-token crash (#1945)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-18 06:54:12 +08:00 |
|
|
Taichang Zhou
|
8a31e7865d
|
Increase timeout for Diffusion Model Test and Diffusion Images API LoRA E2E in Buildkite configurations to 30 minutes. Also, introduce a new timeout constant for diffusion initialization in relevant test files to enhance stability during testing. Update OmniServer initialization to utilize the new timeout settings.
|
2026-03-17 23:43:46 +08:00 |
|
|
tzhouam
|
004c60a031
|
Refactor shutdown and cleanup logic in OmniRunner and OmniStage to improve process termination and resource management. The changes ensure that stage workers are stopped before closing queues, preventing potential orphaned subprocesses. Additionally, enhanced error handling during process termination provides clearer logging for failed shutdown attempts. This update aims to increase the reliability and stability of the shutdown process across the application.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 09:33:28 +00:00 |
|
|
tzhouam
|
722ad6bbae
|
rebase: align vllm-omni with vLLM 0a0a1a198be8
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 03:26:42 +00:00 |
|
|
tzhouam
|
57ac7eb155
|
rebase: align vllm-omni with vLLM 2754231ba3a7
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 09:28:56 +00:00 |
|
|
tzhouam
|
3a508d7b7a
|
rebase: align vllm-omni with vLLM e9163b536e72
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 02:32:39 +00:00 |
|
|
tzhouam
|
f137a1e3ad
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-16 01:49:46 +00:00 |
|
|
汪志鹏
|
284575ab82
|
[CI]: Add/Fix bagel e2e online/offline test (#1895)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-15 18:27:07 +08:00 |
|
|
|
5377619c0b
|
fix: propagate parallel_config through create_default_diffusion (#1878)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-14 17:07:13 +08:00 |
|
|
|
dc72aede40
|
[CI] add multimodal processing correctness tests for Omni models (#1445)
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Ding Zuhao <e1583181@u.nus.edu>
|
2026-03-14 14:15:25 +08:00 |
|
|
Daniel Huang
|
c107f0b336
|
Buildkite hardware ci xpu test (#1340)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-14 11:24:05 +08:00 |
|
|
Alex Brooks
|
e17130090c
|
[BugFix] Fix Max Rank Handling in LoRA (#1397)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-03-14 02:42:54 +00:00 |
|
|
tzhouam
|
97899c6c98
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-13 19:03:57 +00:00 |
|
|
|
92f771d455
|
[Frontend] Rewrite video API for async job lifecycle (#1665)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Gao Han <gaohan19@huawei.com>
|
2026-03-13 17:11:06 +08:00 |
|
|
汪志鹏
|
e0b71056ba
|
[BugFix]: Fix bagel online inference bug (#1804)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-13 08:58:44 +00:00 |
|
|
Gao Han
|
717dbee5a6
|
[CI failed] Disable test for zimage tensor parallelism (#1870)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-03-13 14:52:48 +08:00 |
|
|
tzhouam
|
d3db476f2d
|
Merge branch 'main' into dev/vllm-align
|
2026-03-13 06:51:22 +00:00 |
|
|
Gao Han
|
36c6cb9634
|
[CI failure] Comment out test_zimage_vae_patch_parallel_tp2 (#1856)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-03-13 01:00:16 +08:00 |
|
|
tzhouam
|
72cb4f661b
|
Adjust GPU memory utilization and device settings in qwen2_5_omni_ci.yaml for improved performance
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-12 13:57:52 +00:00 |
|
|
Zeyu Huang | 黃澤宇andHongsheng Liu
|
21e621f84c
|
[Test] Reduce SP & Offloading test cases for L2 (#1839)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-12 13:32:43 +00:00 |
|
|
SYLAR
|
c8c60e1970
|
[Config Refactor][1/2] Model Pipeline Configuration System (#1115)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-12 21:09:34 +08:00 |
|
|
|
28dd1a699d
|
[Model] Extend NPU support for HunyuanImage3 Diffusion Model (#1689)
Signed-off-by: ElleElleWu <1608928702@qq.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: skf1999 <13234016272@163.com>
Co-authored-by: Just-it <1161406585@qq.com>
Co-authored-by: Semmer2 <semmer@live.cn>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-12 20:49:17 +08:00 |
|
|
rongfu.leng
|
7c5159037f
|
[Feat] add wav response_format when stream is true in /v1/audio/speec… (#1819)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2026-03-12 17:45:13 +08:00 |
|
|
Vensen
|
3306fa6611
|
[Feat][Diffusion]: Implement Component-Level VRAM Quota and Resource Domain Isolation (#1582)
Signed-off-by: vensen <vensenmu@gmail.com>
|
2026-03-12 12:17:18 +08:00 |
|
|
|
5d28b6a40c
|
[Feat][Qwen3-TTS] Support streaming audio output for websocket (#1719)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
|
2026-03-11 23:48:41 -04:00 |
|
|
Daniel Huang
|
ac17431745
|
[Enhancement] Patch OmniStage.try_collect() with _proc alive checks (#1560)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-12 10:40:42 +08:00 |
|
|
Yueqian Lin
|
e1efcb7560
|
Fix duplicate get_supported_tasks definition in async_omni.py (#1825)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-11 19:43:37 -04:00 |
|
|
wangyu
|
da4a077155
|
[Test] Skip the qwen3-omni relevant validation for a known issue 1367. (#1812)
Signed-off-by: yenuo26 <410167048@qq.com>
|
2026-03-11 15:00:13 -04:00 |
|
|
Yueqian Lin
|
f144f5effe
|
[Test] Add Qwen3-TTS nightly performance benchmark (#1700)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:07:47 +08:00 |
|
|
Yueqian Lin
|
a6b5519616
|
[Bugfix] Report supported tasks for omni models to skip unnecessary chat init (#1645)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:06:20 +08:00 |
|
|
Didan Deng
|
af9784c03f
|
[Bugfix] Adjust Z-Image Tensor Parallelism Diff Threshold (#1808)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-11 20:30:54 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
74eedd3ef1
|
[Frontend] ComfyUI video & LoRA support (#1596)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-03-11 10:22:45 +00:00 |
|
|
Zeyu Huang | 黃澤宇andHongsheng Liu
|
a19098233b
|
[Test] L4 complete diffusion feature test for Qwen-Image-Edit models (#1682)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-11 18:10:06 +08:00 |
|
|
tzhouam
|
08a2673c66
|
rebase: align vllm-omni with vLLM 84e436ed1c94
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-11 07:29:52 +00:00 |
|
|
JohnJanandwuzhongjian
|
4d89ebaa07
|
[Model]: add FLUX.2-dev model (#1629)
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com>
|
2026-03-11 14:44:18 +08:00 |
|
|
NumberWan
|
617b1d6053
|
Add coordinator module and corresponding unit test (#1465)
Signed-off-by: Jeff Wan <wantszkin2003@gmail.com>
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-03-11 14:36:48 +08:00 |
|
|
Chendi.XueandSYLAR
|
ca37f221a8
|
update GpuMemoryMonitor to DeviceMemoryMonitor for all HW (#1526)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-03-11 12:19:36 +08:00 |
|
|
Didan DengandCanlin Guo
|
7543f2ff3b
|
[Bugfix]: SP attention not enabling when _sp_plan hooks are not applied (#1704)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-03-11 10:49:42 +08:00 |
|
|
Ting FU
|
6ac85d4607
|
[Feat] Enable expert parallel for diffusion MoE layers (#1323)
Signed-off-by: Semmer2 <semmer@live.cn>
|
2026-03-11 10:45:36 +08:00 |
|
|
Juan Pablo Zuluagaandpablo
|
1d0a97f0d1
|
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load (#1714)
Signed-off-by: pablo <pablo@agigo.ai>
Co-authored-by: pablo <pablo@agigo.ai>
|
2026-03-10 21:02:33 +00:00 |
|
|
Hongsheng Liu
|
4027534dbf
|
Revert "Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint" (#1789)
|
2026-03-10 22:40:48 +08:00 |
|
|
zhumingjue138
|
5d62fcd717
|
[CI]: Add core_model and cpu markers for L1 use case. (#1709)
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
|
2026-03-10 17:39:37 +08:00 |
|
|
Daniel Huang
|
745ef312a7
|
[Enhancement][pytest] Check for process running during start server (#1559)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-10 15:44:54 +08:00 |
|
|
Ekagra Ranjan
|
7a560492a2
|
Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)
|
2026-03-09 13:36:46 -04:00 |
|
|
Sy03
|
761eff930a
|
[Fix][Qwen3-TTS] Preserve ref_code decoder context for Base ICL (#1731)
|
2026-03-09 13:36:27 -04:00 |
|