Sy03
c7a78b382a
[CI/Build] Match perf warmups to benchmark concurrency
...
Use enough warmup requests to cover a full concurrent batch while preserving the existing two-request minimum.
Signed-off-by: Sy03 <24841857+Sy0307@users.noreply.github.com >
2026-08-19 16:25:54 +08:00
322600bfb2
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage ( #5524 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: psv666 <2693925048@qq.com >
Co-authored-by: psv666 <2693925048@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-11 14:53:49 +08:00
wangyu and amy-why-3459
4b625d1175
[CI/Build] Resolve hardware-nested perf baselines per concurrency sweep ( #5845 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-06 21:20:04 +08:00
wangyu
7fb62db5c2
[CI]For NPU CI, Nest perf baselines by hardware label (H100/A3) ( #5402 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-08-05 17:35:41 +08:00
SYLAR and lishunyang12
f8a8fbf72e
[Bugfix][CI] Reuse servers across paired perf cases ( #5624 )
...
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
2026-07-31 08:23:17 +00:00
wangyu
2a49b2b217
[CI][Perf] Add JSON mark support and paired parametrize for L4 perf, so as to further support performance‑case selection for NPU‑CI. ( #5084 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-07-16 14:45:00 +00:00
wangyu
0b59dfb94a
[Bugfix] Fix pytest 9.1.0 duplicate parametrization in run_benchmark.py ( #4784 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-03 04:15:32 +00:00
ChenWenjing and Gao Han
834abdaf8b
[ci][nightly] Voxcpm2 performance benchmark ( #3864 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-29 09:44:29 +08:00
wangyu and Hongsheng Liu
4e82192fd6
[CI] optional --assert-baseline and update perf JSON baselines ( #3695 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-20 09:15:53 +08:00
amy-why-3459
309e5c38c6
[BugFix][CI]Fixing occasional CI failures ( #3623 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-18 21:25:37 +08:00
wangyu and Hongsheng Liu
26d481fc84
[CI] Remove VLLM_TEST_CLEAN_GPU_MEMORY to avoid environment variable pollution that causes unnecessary GPU detection, thereby slowing down test case execution. ( #3446 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-10 07:00:29 +08:00
wangyu and Huang, Zeyu
6f2ad7b403
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers ( #2556 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-05-08 14:12:23 +08:00
amy-why-3459 and Hongsheng Liu
01f500a5bf
[perf]Qwen3-Omni performance optimization ( #3203 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-01 22:47:24 +08:00
Hongsheng Liu
9de131e6b0
Revert "[perf]Qwen3-Omni performance optimization" ( #3202 )
2026-04-28 13:23:29 +08:00
amy-why-3459
335e2eb9e4
[perf]Qwen3-Omni performance optimization ( #3164 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-28 11:59:26 +08:00
Yueqian Lin
39e3fd3d12
[Benchmark] Universal TTS benchmark: Qwen3-TTS + VoxCPM2 with 3 task types (voice-clone/default/design) ( #2835 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-24 23:35:33 +08:00
wangyu
e18cb89d5a
[CI] Update test markers and configurations to use 'full_model' for L4 nightly tests ( #2641 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-22 15:14:20 +08:00
wangyu
8a9add1c81
[CI] Restructure vLLM-Omni Test Layout, Fixture Scope, and Support Modules ( #2620 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-20 14:23:42 +08:00
a3903810fe
[Config Refactor][2/N] Pipeline + Deploy Config Schema ( #2383 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: reidliu41 <reid201711@gmail.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: reidliu41 <reid201711@gmail.com >
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-19 14:36:00 +12:00
wangyu
a3ecde98e0
[CI][Bugfix] Fix the error in generating the performance data table and add a fallback mechanism that prevents the result file from being generated when test case execution fails. ( #2839 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-04-17 16:33:46 +08:00
c83f664fe1
[CI][Perf] Add nightly PR labels, consolidate pipeline, and switch benchmark flag to --test-config-file ( #2816 )
...
Signed-off-by: wangyu <410167048@qq.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: inaniloquentee <inani_@stu.xjtu.edu.cn >
2026-04-16 11:13:41 +08:00
wangyu
a782ae4780
[Perf] Enhance benchmark script to support baseline thresholds and proved result handling ( #2789 )
2026-04-15 10:28:28 +08:00
amy-why-3459
ef3f72b9ae
[Tests][Qwen3-Omni]Modify Qwen3-Omni performance test cases ( #2600 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-13 19:03:13 +08:00
c20cac86ce
[Bugfix] Restore user config/runtime stage init timeout ( #2519 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-12 00:48:47 +08:00
wuhang and Didan Deng
cb91cbe61e
[Entrypoint][Refactor]Stage CLI Refactor ( #2020 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-10 14:40:37 +08:00
amy-why-3459
93bb988422
[Tests][Qwen3-Omni] Add performance test cases ( #2011 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-03-28 19:01:44 +08:00
zhumingjue138
c14ab819e3
[Test] L5 Long-Term Stability Test and GPU Memory Monitoring Main L5 last ( #1799 )
2026-03-23 19:04:05 +08:00