Taichang Zhou and Claude Opus 4.8
9678ae58cf
[MR V2] Migrate to Model Runner V2
...
Squashed migration rebased onto current main. Collapses the 46-commit
dev/migrate-MR-v2 history (10 merge commits + superseded pre-rebase work)
into a single commit, so the diff reflects only the genuine MR-V2 feature
(worker_v2/ runners + model_states, omni schedulers, stage engine pipeline,
pooling_output serialization bridge). Content already merged to main
separately (step_audio2, tts_adapters, npu/_310p, etc.) drops out.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-20 07:19:40 +00:00
Yueqian Lin
d75a6433b4
[Refactor] TTS serving adapter framework + migrate TTS models (excl. ming_flash_omni) ( #4330 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-13 04:22:54 +00:00
8f869c8ea5
[Refactor] Output Processor Phase 2: separate multimodal output channel ( #1601 ) ( #2744 )
...
Signed-off-by: Megha Agarwal <agarwalmegha1308@gmail.com >
Signed-off-by: meghaagr13 <divyanshsinghvi@gmail.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: meghaagr13 <divyanshsinghvi@gmail.com >
Co-authored-by: Boao Shi <aoibosh@connect.hku.hk >
Co-authored-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-12 15:19:14 +08:00
wangyu
1b2ab23586
[Test] Automatically clean up audio files generated from requests, and realtime invalid-param coverage ( #4294 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
2026-06-11 05:57:57 +08:00
Clodagh Walsh
aa92a3a35d
[CI/Build] Voxtral TTS Tests ( #3738 )
...
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com >
2026-06-10 20:32:21 +08:00
FED4 and Gao Han
6ae355b9a9
[BugFix] Remove pydub dependency for Python 3.13 compatibility ( #4035 )
...
Signed-off-by: FED4 <feiyyfrank@outlook.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-09 20:45:57 -07:00
07737e6c61
[Test] Add prefix caching + audio output regression test ( #3510 ) ( #3604 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
2026-06-03 09:17:53 +00:00
Chendi.Xue
2a2033df02
[XPU][Rebase v0.22] Fix for 0.22 rebase ( #4059 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
2026-06-02 10:16:44 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
wuhang and Alicia
802a6242f0
[Bugfix][Tests] Remove unnecessary device map in tests init ( #3958 )
...
Signed-off-by: WU Hang <whlbx@hotmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-05-30 16:18:48 +08:00
Viacheslav Klimkov and Yueqian Lin
914e92cf80
[Refactor][Qwen3-TTS] Extract reusable prompt-embeds builder and make tts_pad_embed a persistent buffer ( #3992 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-30 16:11:00 +08:00
boatman and sphinxkkkbc
4d9262a6eb
[Feat]Support voice clone for omnivoice in online serving & add seed parameter for reproducible ( #3668 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-29 07:42:08 +00:00
Ziming Huang and tzhouam
220ce0b4ea
[Test] Add long text output correctness test for Qwen3-Omni ( #3539 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: tzhouam <tzhouam@connect.ust.hk >
2026-05-28 08:27:29 +08:00
Alex Brooks
cc0e15ba57
[Bugfix] Fix LTX2 CacheDiT Integration ( #3621 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-24 21:55:34 +08:00
Yueqian Lin
4e4458e7bf
[Bugfix][CI] Run Whisper validation on CPU for single-GPU runners ( #3822 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-23 11:46:14 +12:00
wangyu
bd83ac9b4b
[CI] invalid_param reliability suite and weekly http_invalid jobs ( #3652 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-19 14:28:47 +08:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
Canlin Guo
0ab1d30056
[CI][Test] Add NPU nightly tests ( #3480 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-13 16:58:17 +12:00
wangyu
ac5fbed6c0
[CI][Bugfix] Improve e2e latency logging, update response classes to include detailed latency documentation and add startup time logging ( #3246 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
2026-05-12 10:23:56 +08:00
wangyu and Hongsheng Liu
26d481fc84
[CI] Remove VLLM_TEST_CLEAN_GPU_MEMORY to avoid environment variable pollution that causes unnecessary GPU detection, thereby slowing down test case execution. ( #3446 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-10 07:00:29 +08:00
wangyu and Huang, Zeyu
6f2ad7b403
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers ( #2556 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-05-08 14:12:23 +08:00
Nick Cao
e6466cf0e6
[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. ( #3365 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-07 23:23:59 +08:00
Daniel Huang and Hongsheng Liu
c483a23deb
[CI Patch] Qwen 2.5 CI Fixes for Intel XPU ( #3083 )
...
Signed-off-by: Daniel Huang <daniel1.huang@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-07 08:08:25 +08:00
1e5f288a91
[FEAT] support multi-stage deployment ( #2396 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
2026-05-06 19:33:18 +08:00
b076006c35
[BugFix] Fix Whitelist optimization CI failure ( #3290 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-06 14:25:20 +08:00
TJian
a77c56725d
[ROCm] [CI] [Bugfix] 2/N Fix Qwen2.5 and Qwen3 test ( #3343 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-05-05 23:28:37 +08:00
Juan Pablo Zuluaga and JuanPZuluaga
b64ab05d09
[TTS][SpeakerCacheManager] A global speaker cache manager for Voice Cloning ( #2630 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
2026-05-05 10:53:45 -04:00
Zeyu Huang | 黃澤宇 and Copilot Autofix powered by AI
f19891e4f1
[bugfix][CI] Diffusers backend update ( #3096 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-05 20:54:39 +08:00
Yueqian Lin
703e31fc47
[Docs] Consolidate per-model TTS examples into a single hub ( #3234 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-05 08:41:29 +12:00
Alex Brooks
e1b30061b6
[CI] Use Logprobs Check for Flaky Prefix Cache Test ( #3199 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-05 00:55:54 +08:00
c708aecb18
[Diffusion] [Model] Support AudioX ( #2077 )
...
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang <zhang.jian@u.nus.edu >
Signed-off-by: Zhang Jian <e0322744@u.nus.edu >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Zhang Jian <e0322744@u.nus.edu >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-05-04 10:24:35 -04:00
Yueqian Lin and Hongsheng Liu
7491b67446
[Bugfix][MOSS-TTS-Nano] Drop fictional voice presets, require ref_audio ( #3192 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-03 16:35:35 +12:00
Yuanheng Zhao and Hongsheng Liu
d49356e4ca
[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs ( #3154 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-03 14:43:49 +12:00
Gao Han
704b6bb6e6
[CI failed]Revert "[Config Refactor] Derive deploy override fields from stage config" ( #3287 )
...
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-01 04:39:54 +01:00
Haco
01ebc0cdf5
[Config Refactor] Derive deploy override fields from stage config ( #3162 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
2026-05-01 01:04:03 +08:00
Alex Brooks and SYLAR
bede8e02d8
[Misc] Remove Entrypoint Hijack for vLLM / 0.20.0 Changes ( #3082 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-30 12:00:21 +00:00
wangyu
fa945b2626
[Bugfix][CI] Enhance get_open_port function to handle port binding more robustly ( #3216 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-30 14:27:05 +08:00
Yueqian Lin
b1ff695029
[Bugfix][CI] Vendor Qwen3-TTS and CosyVoice3 reference audio fixtures ( #3267 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-30 08:44:05 +08:00
Zhou Taichang and Yuanheng Zhao
7f2b1e9386
[Rebase] Rebase to vllm 0.20.0 ( #3232 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-04-30 09:56:59 +12:00
wangyu
00c11c8b87
[CI] Update nightly/ready test scheduling and unskip selected cases ( #2945 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-04-27 12:46:45 +08:00
zhumingjue138
a150194b11
[Test] L5 reliability test for wan2.2 and qwen3_omni model ( #2972 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: [Your Name] <[Your Email]>
Signed-off-by: zhumingjue138 <zhumingjue@huawei.com >
2026-04-27 12:12:52 +08:00
汪志鹏 and SYLAR
37e5954acf
[Config Refactor]: Remove bagel yaml ( #2936 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-24 21:21:30 +08:00
Alex Brooks
9ebfbf9fde
[CI] Re-enable Prefix Cache Test ( #2869 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-24 12:58:25 +08:00
wangyu
e18cb89d5a
[CI] Update test markers and configurations to use 'full_model' for L4 nightly tests ( #2641 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-22 15:14:20 +08:00
ChenWenjing
e82c0a5e1d
[ci]add merge ci for streaming input ( #2965 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-04-22 12:08:56 +08:00
wangyu
de4e47237a
[CI][Bugfix] Improve cosine similarity calculation by incorporating length harmony adjustment in text comparison ( #2964 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-21 11:50:50 +08:00
wangyu
8a9add1c81
[CI] Restructure vLLM-Omni Test Layout, Fixture Scope, and Support Modules ( #2620 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-20 14:23:42 +08:00
