Sy03
c7a78b382a
[CI/Build] Match perf warmups to benchmark concurrency
...
Use enough warmup requests to cover a full concurrent batch while preserving the existing two-request minimum.
Signed-off-by: Sy03 <24841857+Sy0307@users.noreply.github.com >
2026-08-19 16:25:54 +08:00
zhumingjue138
cd9ae66b3a
[Bugfix][Test] fix Qwen3-omni OOM reliability and drop voxcpm2 stability/reliability test cases ( #6299 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
2026-08-18 17:36:08 +08:00
Yueqian Lin
b283215c28
[Model] Add MiniMax Music 3 text-to-music ( #6186 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-08-18 04:33:13 +00:00
wangyu and Cursor
4616823125
[CI]demote slow nightly cases and trim Qwen-Image-Edit coverage ( #5944 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-17 11:21:28 +08:00
Yueqian Lin
555336e887
[CI] Refresh Voxtral-4B-TTS perf baselines from a clean window ( #6032 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-08-15 11:51:56 +00:00
amy-why-3459
b792578d89
[CI][MiniCPM-o] Add MiniCPM-o 4.5 perf coverage to the ready gate ( #6079 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-12 11:32:36 +08:00
322600bfb2
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage ( #5524 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: psv666 <2693925048@qq.com >
Co-authored-by: psv666 <2693925048@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-11 14:53:49 +08:00
ee118ab492
[Bugfix] Per-replica fault isolation: keep API server alive on single-stage death ( #4285 ) ( #4583 )
...
Signed-off-by: Shenglei Fu <sfu@confluent.io >
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-10 23:00:18 -04:00
bjf-frz and Alicia
1ee2fff532
Update Wan2.2 I2V performance baselines ( #5977 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-08-10 15:24:59 +08:00
WeiQing Chen
a874b8e09b
[Perf][CI] Add MiniMax-H3 4xH100 diffusion perf config ( #5836 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-08-07 00:12:07 +08:00
wangyu and amy-why-3459
4b625d1175
[CI/Build] Resolve hardware-nested perf baselines per concurrency sweep ( #5845 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-06 21:20:04 +08:00
wangyu
7fb62db5c2
[CI]For NPU CI, Nest perf baselines by hardware label (H100/A3) ( #5402 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-08-05 17:35:41 +08:00
wangyu
0a7ac4c67e
[CI/Build] Speed up omni sleep-mode entrypoint tests with shared engines ( #5713 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-08-05 03:26:23 +00:00
Yukim1
7a2007cc17
[Refactor] Remove legacy --stage-configs-path from the serve CLI ( #5647 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
2026-08-03 23:41:52 +08:00
zzh
e0c2b9d73f
Adapt HunyuanImage3.0 test for npu ( #5436 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-08-03 06:31:50 +00:00
SYLAR and lishunyang12
f8a8fbf72e
[Bugfix][CI] Reuse servers across paired perf cases ( #5624 )
...
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
2026-07-31 08:23:17 +00:00
aa5364f705
[refactor][MiniCPM-o] Consolidate MiniCPM-o 4.5 2-GPU deploy configs and E2E tests ( #5458 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-07-30 09:56:19 +08:00
zzh
925347332f
Add vae-patch-parallel-size and vae-use-tiling for HunyuanImage Benchmark ( #5502 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-07-29 02:43:45 -07:00
Sy03 and Hongsheng Liu
0feb92bdfa
[Bugfix][Minicpm] Support full-duplex three-stage serving ( #5380 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-29 01:58:34 +08:00
5014fea4a0
[New Model] support nemotron Audex ( #4976 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-28 03:58:22 +00:00
Weiming Liao and wangyu
f2c5152df0
[CI][NPU]: Add nightly performance test for NPU - qwen3-omni/wan2.2/qwen-image-edit-2511 ( #5339 )
...
Signed-off-by: Weiming Liao <liaowm5@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-07-28 11:44:30 +08:00
b6c4578dac
[BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) ( #5237 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-25 17:00:13 -07:00
Jae and Cursor
ee33954dff
[Model] Support Boogu/Boogu-Image-0.1-Base and Boogu/Boogu-Image-0.1-Edit ( #4995 )
...
Signed-off-by: zzehli <jaeli_ottawa@outlook.com >
Signed-off-by: jl <jaeli_ottawa@outlook.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-07-21 18:58:56 +00:00
Alicia
0034eaa9c3
Update perf baseline base on 7/5-7/11 7 days avg. ( #5231 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-07-21 12:26:22 +00:00
wtz2333 and hsliuustc0106
5a6a93dc5f
[diffusion][model] Add LingBot Video dense and MoE support ( #5035 )
...
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com >
Signed-off-by: wtz2333 <2955110911@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-07-21 17:27:29 +08:00
zhumingjue138
4d799997d3
[Bugfix] Fix issue 5205, add trust-remote-code ( #5213 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
2026-07-20 15:20:53 +00:00
Weiming Liao and wangyu
7aa5c9a090
[CI][NPU]: Add nightly performance test for NPU - Qwen3-TTS on A3 ( #5158 )
...
Signed-off-by: Weiming Liao <liaowm5@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-07-17 17:32:48 +08:00
wangyu
2a49b2b217
[CI][Perf] Add JSON mark support and paired parametrize for L4 perf, so as to further support performance‑case selection for NPU‑CI. ( #5084 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-07-16 14:45:00 +00:00
wangyu
795e4e0160
[CI] Add local job runner scripts for L2-L4 pytest execution ( #4672 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-15 14:18:58 +08:00
bjf-frz
b14ff23041
[PERF][CI]Add Cosmos3 diffusion perf config ( #5010 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
2026-07-14 10:25:17 +00:00
wangyu
98229b08ba
[Bugfix] Pass --trust-remote-code via HunyuanImage3 DFX serve_args ( #5006 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-13 15:34:46 +08:00
wangyu
dda88a6f86
[BugFix] Align invalid layers DFX tests with 2-10 range ( #5044 ) ( #5047 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-12 09:50:54 +00:00
leo
b3a4819694
Fix VoxCPM2 perf server trust remote code ( #4984 )
...
Signed-off-by: leo <yaoliu548926@gmail.com >
2026-07-10 04:01:10 +00:00
wangyu
0b59dfb94a
[Bugfix] Fix pytest 9.1.0 duplicate parametrization in run_benchmark.py ( #4784 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-03 04:15:32 +00:00
wangyu and Hongsheng Liu
7619ed6b82
[CI] Reducing mithril-h100-pool in ready&merge CI, optimize ready CI duration ( #4354 )
...
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: [Your Name] <[Your Email]>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-29 05:17:57 +00:00
zhumingjue138
0d0f4e669e
[Test] add reliability test case for HunyuanImage-3.0-Instruct and reliability/stability test for VoxCPM2 ( #4600 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: [Your Name] [Your Email]
2026-06-25 04:41:19 +00:00
50bc51ffdf
fix: return proper HTTP status codes for audio voice endpoints ( #3969 )
...
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-22 22:57:07 +00:00
+2
ec4ec0f604
Add SSE stream_format support for audio speech streaming ( #4490 )
...
Signed-off-by: syd520zy <529477025@qq.com >
Signed-off-by: faceless void <100186390+syd520zy@users.noreply.github.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Signed-off-by: kTorp <Kristoffer.Torp@amd.com >
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: Hyoseop Song <crad_on25@naver.com >
Signed-off-by: Hyoseop Song <crad_on25@naver.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Chendi.Xue <chendi.xue@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Kristoffer <kristoffer.torp@amd.com >
Co-authored-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Hyoseop Song <crad_on25@naver.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-22 06:42:25 +00:00
Alicia
db8bc2c71d
Update VoxCPM and Qwen3TTS perf baseline. ( #4521 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-06-18 16:56:13 +08:00
NATURE and Alicia
83e3b129f0
[Bugfix] Fix missing memory metrics info for bagel (ar->dit diffusion) ( #4477 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-06-17 14:06:14 +08:00
1761253005
[CI] Update perf json baselines ( #4289 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: herotai214 <herotai214@gmail.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: herotai214 <herotai214@gmail.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
2026-06-17 14:02:50 +08:00
e27fd46ab9
[Perf] Optimize Higgs Audio v3 serving ( #4204 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-11 13:29:31 -07:00
wangyu
1b2ab23586
[Test] Automatically clean up audio files generated from requests, and realtime invalid-param coverage ( #4294 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
2026-06-11 05:57:57 +08:00
Clodagh Walsh
aa92a3a35d
[CI/Build] Voxtral TTS Tests ( #3738 )
...
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com >
2026-06-10 20:32:21 +08:00
zhumingjue138
2d9e5e0515
[Test] skip oom test case for issue #4285 ( #4311 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
2026-06-10 10:29:33 +00:00
Chenguang Zheng
b3dd0a4baf
[Fix] Update Qwen3 Omni multi-replica perf baselines ( #4175 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
2026-06-05 09:22:53 +00:00
dengyunyang
469c1dc87e
[HunyuanImage3.0][Performance][Optimazation]Adjust perf config ( #4149 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-06-04 22:54:46 +08:00
amy-why-3459
519cf3ecf1
[Refactor] [Qwen3-Omni]Modify the thinker's sampling parameters to align with transformers. ( #4137 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-04 22:49:04 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
dengyunyang
3b317285c4
[HunyuanImage][Perf] adapt to deploy config changes ( #3996 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-05-30 14:48:50 +08:00