 hywandAlex Brooks
|
2a68471715
|
[Bugfix] Reject failed diffusion benchmark warmups (#7092)
Signed-off-by: hyw <yuweih205@gmail.com>
Signed-off-by: HuangYuwei <yuweih205@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
|
2026-09-16 17:09:23 +00:00 |
|
|
psv666andamy-why-3459
|
1053f7b0bd
|
[Bugfix] Preserve benchmark metric sample counts in results (#7624)
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-16 08:39:01 -07:00 |
|
|
|
e6cebf8557
|
[Bugfix][Omni-DuplexEval] Load local Hugging Face dataset layouts in duplex eval loader (#7331)
Signed-off-by: RyanYun09 <RyanYun09@users.noreply.github.com>
Co-authored-by: RyanYun09 <RyanYun09@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-16 20:05:52 +08:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
ZacheryAU
|
f062124ba4
|
[Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242)
|
2026-09-14 15:25:59 -07:00 |
|
|
|
e284d907b5
|
[Perf][Frontend] Chunk in-memory image file responses (#7459)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-13 20:33:10 +08:00 |
|
|
Nick CaoandClaude Sonnet 5
|
498c41b8d6
|
[Realtime] Emit current (non-beta) OpenAI audio/transcript event names (#7339)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-09-11 08:50:12 +08:00 |
|
|
Sy03
|
b02862beee
|
[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-09 13:02:12 -07:00 |
|
|
|
fdaf4e31bd
|
Add vLLM-Omni library info to Hugging Face Hub requests (#5381)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-08 10:08:38 -06:00 |
|
|
tlysanhuo
|
7c2e30afd3
|
[Bugfix] Bound omni benchmark per-request timeout to 15 min by default (#7130)
Signed-off-by: tly <2200895168@qq.com>
|
2026-09-08 02:00:25 -07:00 |
|
|
ZacheryAU
|
b1ec136bd7
|
[Frontend] Add omni benchmark support for image and video endpoints (#4728)
|
2026-09-08 09:28:21 +08:00 |
|
|
|
5d7fdf9350
|
[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-05 08:20:21 +00:00 |
|
|
|
8d98cc0cb7
|
[Benchmark] Add local OmniInteract performance cases (#6817)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Ruirui Yang | Rein <73573651+R2-Y@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-04 10:36:02 +08:00 |
|
|
akshatvishu
|
f321cdbe16
|
[Bugfix] Use Seed-TTS reference audio with MiniCPM-o 4.5 (#6628)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
|
2026-08-31 10:27:34 +08:00 |
|
|
mokekeandmokashliu
|
1a9d598d2b
|
[Frontend] Encode interleaved video frames in parallel (#6776)
Signed-off-by: mokashliu <mokashliu@tencent.com>
Co-authored-by: mokashliu <mokashliu@tencent.com>
|
2026-08-31 07:04:27 +08:00 |
|
|
Gao Han
|
71748388f8
|
[Bugfix] Recover Omni benchmark TPOT from Stage 0 metrics (#6818)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-08-31 00:43:25 +08:00 |
|
|
Honghan Zhuandamy-why-3459
|
72a1ce488b
|
[Bugfix] Avoid invalid TPOT metrics (#6696)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-29 11:56:37 +00:00 |
|
|
amy-why-3459
|
da94c3ebe1
|
[Bugfix][MiniCPM-o] Bind omni-duplex video frames to the unit they close (#6404)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-28 16:58:20 +08:00 |
|
|
Zhanshenzhuiandamy-why-3459
|
c6df39e9f7
|
[Benchmark][MiniCPM-o] Add Omni-DuplexEval support (#6634)
Signed-off-by: Zhanshenzhui <99891002+zyforsure@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-27 16:31:50 +08:00 |
|
|
NATURE
|
497c537c6f
|
[Benchmark] Add local OmniInteract realtime benchmark (#6522)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-08-25 15:32:58 +00:00 |
|
|
Zhang BowenandHongsheng Liu
|
4882a36c41
|
[Model][Frontend] MiniMax-H3: Add opt-in planar video response encoding (#6288)
Signed-off-by: MosCloud <bwzhang1991@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-22 04:04:14 +00:00 |
|
|
psv666andamy-why-3459
|
199ef7779c
|
[Bugfix][MiniCPM-o] Load Daily-Omni QA metadata from the hub cache (#6276)
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-18 10:53:55 +08:00 |
|
|
amy-why-3459
|
7cd826d28c
|
[Bugfix][MiniCPM-o] Align Daily-Omni offline loading and duplex soft-… (#6095)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-12 18:36:31 +08:00 |
|
|
Sy03andYueqian Lin
|
58007c0084
|
[New Model] Support IndexTTS 2.5 (#5957)
Signed-off-by: Sysy <1370724210@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-08-11 23:00:35 +00:00 |
|
|
|
322600bfb2
|
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage (#5524)
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: psv666 <2693925048@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-11 14:53:49 +08:00 |
|
|
amy-why-3459andCursor
|
67aa6c55a4
|
[Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… (#5625)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-31 22:41:00 -07:00 |
|
|
rein yangandSy03
|
ad3a162eb8
|
[perf] Minicpm o4.5 optimization (#5228)
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Co-authored-by: Sy03 <1370724210@qq.com>
|
2026-07-24 17:20:39 +08:00 |
|
|
ZacheryAU
|
4c23a3164b
|
[Refactor] Split vllm_omni/entrypoints/cli/benchmark/serve.py (#5206)
|
2026-07-23 16:00:32 +00:00 |
|
|
amy-why-3459
|
d897852258
|
[BugFix] Fix the issue of incorrect generated tokens (#4461)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-06-17 02:31:48 +00:00 |
|
|
Zhou Taichang
|
7b837944a1
|
[Rebase] Rebase to vllm 0.23.0 (#4286)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-06-13 16:43:02 +00:00 |
|
|
Jianbao Huang
|
6cefe91370
|
[Perf] Enable fused RMSNorm for HunyuanImage3 (#3959)
|
2026-06-05 07:41:56 +00:00 |
|
|
Yueqian LinandHongsheng Liu
|
f99e8b2d3c
|
[Bench] Add audio-streaming continuity metric for TTS (#3618)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-20 05:08:56 +00:00 |
|
|
bjf-frzandbjfwhite
|
1fa734419e
|
[Refactor]Rename diffusion benchmark backend to endpoint (#3137)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Signed-off-by: bjfwhite <baijingfan1@huawei.com>
Co-authored-by: bjfwhite <baijingfan1@huawei.com>
|
2026-05-19 11:30:33 +08:00 |
|
|
Yueqian Lin
|
990566aef1
|
[Bugfix][TTS] Drop meaningless TTFT from speech-endpoint benchmarks (#3674)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-05-18 17:18:18 +08:00 |
|
|
Zhou TaichangandYuanheng Zhao
|
7f2b1e9386
|
[Rebase] Rebase to vllm 0.20.0 (#3232)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
|
2026-04-30 09:56:59 +12:00 |
|
|
Yueqian LinandHongsheng Liu
|
afa2b09684
|
feat: add MOSS-TTS-Nano single-stage TTS support (#2753)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-27 10:26:26 +08:00 |
|
|
Alex Brooks
|
52c9ce2dac
|
[CI] Fix Seed TTS Simple Unit Tests (#3126)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-04-25 10:21:49 +08:00 |
|
|
Yueqian Lin
|
39e3fd3d12
|
[Benchmark] Universal TTS benchmark: Qwen3-TTS + VoxCPM2 with 3 task types (voice-clone/default/design) (#2835)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-24 23:35:33 +08:00 |
|
|
amy-why-3459
|
3aa84c4742
|
[Tests]Add accuracy benchmark L4 test cases (#2843)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-23 09:40:43 +08:00 |
|
|
NumberWan
|
ead87aa521
|
[BugFix] Surface diffusion metrics in chat completions; sanitize Bagel img2img mm kwargs (#2932)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-04-22 16:57:01 +00:00 |
|
|
wangyu
|
e18cb89d5a
|
[CI] Update test markers and configurations to use 'full_model' for L4 nightly tests (#2641)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-04-22 15:14:20 +08:00 |
|
|
Dnoob
|
7e7efdd1ab
|
[Bugfix] Fix benchmark Total input tokens for multimodal requests (#2540) (#2549)
Signed-off-by: Dnoob <dxpouo@gmail.com>
|
2026-04-08 11:00:53 +00:00 |
|
|
WeiQing Chen
|
c392ce21e9
|
[Accuracy Benchmark] feat: add accuracy benchmark integrations for t2i and i2i (#1917)
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-03-26 17:27:29 +08:00 |
|
|
wangyu
|
fafa248665
|
[Test] Implement mock HTTP request handling in benchmark CLI tests (#2014)
Signed-off-by: yenuo26 <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-03-20 16:13:39 +08:00 |
|
|
TJian
|
0239057cba
|
[CI] [ROCm] Setup test-ready.yml and test-merge.yml (#2017)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-03-19 14:26:31 +00:00 |
|
|
Daniel Huang
|
c107f0b336
|
Buildkite hardware ci xpu test (#1340)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-14 11:24:05 +08:00 |
|
|
Zeyu Huang | 黃澤宇andHongsheng Liu
|
a19098233b
|
[Test] L4 complete diffusion feature test for Qwen-Image-Edit models (#1682)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-11 18:10:06 +08:00 |
|
|
wangyu
|
cd2234a1bf
|
[CI] Modify some CI test cases to run on L4 environment to reduce H100 resource usage. (#1543)
Signed-off-by: yenuo26 <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-02-28 14:41:51 +08:00 |
|
|
Yuanheng Zhao
|
ed08a216c1
|
[Misc] Migrate L1 tests to use pytest-mock (#1315)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
|
2026-02-26 17:08:39 +08:00 |
|
|
John Liu BUAA
|
f117a07271
|
[Bugfix] reused metrics to modify the API Server token statistics in Stream Response (#1301)
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com>
|
2026-02-12 17:24:01 +08:00 |
|