 psv666
|
2d00d86e5e
|
[CI/Build] Fix Qwen3-Omni Talker benchmark workload (#8057)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-24 23:56:53 +08:00 |
|
|
ZacheryAUandGao Han
|
926ba72793
|
[Frontend][Benchmark] Add judger and accuracy metrics for OmniInterac… (#7317)
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 08:34:23 +00:00 |
|
|
wangyu
|
0570b0da7e
|
[CI][Perf] migrate diffusion DFX benches to vllm bench serve --omni (#7737)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-09-21 19:16:39 -07:00 |
|
|
|
fdaf4e31bd
|
Add vLLM-Omni library info to Hugging Face Hub requests (#5381)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-08 10:08:38 -06:00 |
|
|
|
8d98cc0cb7
|
[Benchmark] Add local OmniInteract performance cases (#6817)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Ruirui Yang | Rein <73573651+R2-Y@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-04 10:36:02 +08:00 |
|
|
|
95a9311696
|
[CI] Select mirror_hardwares presets via MIRROR_HW (H100/B200) (#5543)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Bo Li <22713281+bobboli@users.noreply.github.com>
|
2026-09-02 15:39:49 +00:00 |
|
|
Honghan Zhuandamy-why-3459
|
72a1ce488b
|
[Bugfix] Avoid invalid TPOT metrics (#6696)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-29 11:56:37 +00:00 |
|
|
Sy03andSy03
|
480e10ba9c
|
[CI/Build] Match perf warmups to benchmark concurrency (#6356)
Signed-off-by: Sy03 <24841857+Sy0307@users.noreply.github.com>
Co-authored-by: Sy03 <24841857+Sy0307@users.noreply.github.com>
|
2026-08-20 00:25:49 -07:00 |
|
|
|
322600bfb2
|
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage (#5524)
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: psv666 <2693925048@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-11 14:53:49 +08:00 |
|
|
WeiQing Chen
|
a874b8e09b
|
[Perf][CI] Add MiniMax-H3 4xH100 diffusion perf config (#5836)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-08-07 00:12:07 +08:00 |
|
|
wangyuandamy-why-3459
|
4b625d1175
|
[CI/Build] Resolve hardware-nested perf baselines per concurrency sweep (#5845)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-06 21:20:04 +08:00 |
|
|
wangyu
|
7fb62db5c2
|
[CI]For NPU CI, Nest perf baselines by hardware label (H100/A3) (#5402)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-08-05 17:35:41 +08:00 |
|
|
SYLARandlishunyang12
|
f8a8fbf72e
|
[Bugfix][CI] Reuse servers across paired perf cases (#5624)
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
|
2026-07-31 08:23:17 +00:00 |
|
|
Weiming Liaoandwangyu
|
f2c5152df0
|
[CI][NPU]: Add nightly performance test for NPU - qwen3-omni/wan2.2/qwen-image-edit-2511 (#5339)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-07-28 11:44:30 +08:00 |
|
|
wangyu
|
2a49b2b217
|
[CI][Perf] Add JSON mark support and paired parametrize for L4 perf, so as to further support performance‑case selection for NPU‑CI. (#5084)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-07-16 14:45:00 +00:00 |
|
|
wangyu
|
795e4e0160
|
[CI] Add local job runner scripts for L2-L4 pytest execution (#4672)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-07-15 14:18:58 +08:00 |
|
|
bjf-frz
|
b14ff23041
|
[PERF][CI]Add Cosmos3 diffusion perf config (#5010)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-07-14 10:25:17 +00:00 |
|
|
wangyu
|
0b59dfb94a
|
[Bugfix] Fix pytest 9.1.0 duplicate parametrization in run_benchmark.py (#4784)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-07-03 04:15:32 +00:00 |
|
|
NATUREandAlicia
|
83e3b129f0
|
[Bugfix] Fix missing memory metrics info for bagel (ar->dit diffusion) (#4477)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-06-17 14:06:14 +08:00 |
|
|
+1
|
f92d84fcf9
|
[Rebase] Rebase to vllm releases/v0.22.0 (#3891)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: david6666666 <530634352@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: nainiu258 <cperfect02@163.com>
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com>
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com>
Co-authored-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com>
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-06-01 11:08:12 +08:00 |
|
|
ChenWenjingandGao Han
|
834abdaf8b
|
[ci][nightly] Voxcpm2 performance benchmark (#3864)
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-05-29 09:44:29 +08:00 |
|
|
dengyunyang
|
36eb8afba5
|
[HunyuanImage][End2End Performance CI] Add hunyuan end2end test (#3849)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-05-26 16:45:05 +08:00 |
|
|
Didan DengandGao Han
|
410a6a20b0
|
[Test] Qwen-Image Perf Test with High Concurrency (#2822)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-05-26 02:56:01 +00:00 |
|
|
wangyuandHongsheng Liu
|
4e82192fd6
|
[CI] optional --assert-baseline and update perf JSON baselines (#3695)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-20 09:15:53 +08:00 |
|
|
bjf-frzandbjfwhite
|
1fa734419e
|
[Refactor]Rename diffusion benchmark backend to endpoint (#3137)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Signed-off-by: bjfwhite <baijingfan1@huawei.com>
Co-authored-by: bjfwhite <baijingfan1@huawei.com>
|
2026-05-19 11:30:33 +08:00 |
|
|
amy-why-3459
|
309e5c38c6
|
[BugFix][CI]Fixing occasional CI failures (#3623)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-05-18 21:25:37 +08:00 |
|
|
wangyuandHongsheng Liu
|
26d481fc84
|
[CI] Remove VLLM_TEST_CLEAN_GPU_MEMORY to avoid environment variable pollution that causes unnecessary GPU detection, thereby slowing down test case execution. (#3446)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-10 07:00:29 +08:00 |
|
|
wangyuandHuang, Zeyu
|
6f2ad7b403
|
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers (#2556)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-05-08 14:12:23 +08:00 |
|
|
|
d0b531520d
|
[Performance CI ]Hunyuan Image 3.0 DIT bench test (#2495)
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
Signed-off-by: dengyunyang <584797741@qq.com>
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Signed-off-by: ChenZhao <bounty-hunter@users.noreply.github.com>
Signed-off-by: zuiho <2324465096@qq.com>
Co-authored-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: TaffyOfficial <2587297563@qq.com>
|
2026-05-05 20:05:46 +08:00 |
|
|
amy-why-3459andHongsheng Liu
|
01f500a5bf
|
[perf]Qwen3-Omni performance optimization (#3203)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-01 22:47:24 +08:00 |
|
|
Hongsheng Liu
|
9de131e6b0
|
Revert "[perf]Qwen3-Omni performance optimization" (#3202)
|
2026-04-28 13:23:29 +08:00 |
|
|
amy-why-3459
|
335e2eb9e4
|
[perf]Qwen3-Omni performance optimization (#3164)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-28 11:59:26 +08:00 |
|
|
Yueqian Lin
|
39e3fd3d12
|
[Benchmark] Universal TTS benchmark: Qwen3-TTS + VoxCPM2 with 3 task types (voice-clone/default/design) (#2835)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-24 23:35:33 +08:00 |
|
|
bjf-frz
|
fb4204ebf6
|
[CI][Perf] Add Wan22 i2v perf nightly ci (#3063)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-04-24 16:58:45 +08:00 |
|
|
wangyu
|
e18cb89d5a
|
[CI] Update test markers and configurations to use 'full_model' for L4 nightly tests (#2641)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-04-22 15:14:20 +08:00 |
|
|
wangyu
|
8a9add1c81
|
[CI] Restructure vLLM-Omni Test Layout, Fixture Scope, and Support Modules (#2620)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-04-20 14:23:42 +08:00 |
|
|
|
a3903810fe
|
[Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-19 14:36:00 +12:00 |
|
|
wangyu
|
a3ecde98e0
|
[CI][Bugfix] Fix the error in generating the performance data table and add a fallback mechanism that prevents the result file from being generated when test case execution fails. (#2839)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-04-17 16:33:46 +08:00 |
|
|
|
c83f664fe1
|
[CI][Perf] Add nightly PR labels, consolidate pipeline, and switch benchmark flag to --test-config-file (#2816)
Signed-off-by: wangyu <410167048@qq.com>
Co-authored-by: Y. Fisher <yukexiong1@huawei.com>
Co-authored-by: inaniloquentee <inani_@stu.xjtu.edu.cn>
|
2026-04-16 11:13:41 +08:00 |
|
|
wangyu
|
a782ae4780
|
[Perf] Enhance benchmark script to support baseline thresholds and proved result handling (#2789)
|
2026-04-15 10:28:28 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
8d23549b29
|
[CI] Qwen image edit performance benckmark (#2216)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-04-14 11:35:56 +08:00 |
|
|
amy-why-3459
|
ef3f72b9ae
|
[Tests][Qwen3-Omni]Modify Qwen3-Omni performance test cases (#2600)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-13 19:03:13 +08:00 |
|
|
|
c20cac86ce
|
[Bugfix] Restore user config/runtime stage init timeout (#2519)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-04-12 00:48:47 +08:00 |
|
|
wuhangandDidan Deng
|
cb91cbe61e
|
[Entrypoint][Refactor]Stage CLI Refactor (#2020)
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-04-10 14:40:37 +08:00 |
|
|
amy-why-3459
|
93bb988422
|
[Tests][Qwen3-Omni] Add performance test cases (#2011)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-03-28 19:01:44 +08:00 |
|
|
|
c139ee4aed
|
[CI] remove benchmark/testing comparison w/ other frameworks (#2179)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-27 17:26:18 +08:00 |
|
|
Didan Deng
|
c39225724d
|
[Perf] Qwen-Image Nightly Performance CI Improvement (#2111)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-24 16:52:48 +08:00 |
|
|
zhumingjue138
|
c14ab819e3
|
[Test] L5 Long-Term Stability Test and GPU Memory Monitoring Main L5 last (#1799)
|
2026-03-23 19:04:05 +08:00 |
|