 psv666
|
2d00d86e5e
|
[CI/Build] Fix Qwen3-Omni Talker benchmark workload (#8057)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-24 23:56:53 +08:00 |
|
|
ZacheryAUandGao Han
|
926ba72793
|
[Frontend][Benchmark] Add judger and accuracy metrics for OmniInterac… (#7317)
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 08:34:23 +00:00 |
|
|
|
59db6a4285
|
[Rebase] Rebase to vLLM 0.30.0 (#7820)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-22 15:52:01 +00:00 |
|
|
Sun
|
d278aa8057
|
[Bugfix] Mark image edit benchmark stream errors as failed (#8015)
Signed-off-by: levius <2114377220@qq.com>
|
2026-09-22 14:56:30 +00:00 |
|
|
Sun
|
03ccce9a99
|
[Bugfix] Mark Omni chat benchmark streams with error events as failed (#8000)
Signed-off-by: levius <2114377220@qq.com>
|
2026-09-22 06:28:18 -07:00 |
|
|
wangyu
|
0570b0da7e
|
[CI][Perf] migrate diffusion DFX benches to vllm bench serve --omni (#7737)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-09-21 19:16:39 -07:00 |
|
|
amy-why-3459
|
9f5521351e
|
[Benchmark][MiniCPM-o] Port Video-MME dataset support to Omni bench s… (#6987)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-20 17:15:53 +08:00 |
|
|
psv666andamy-why-3459
|
1053f7b0bd
|
[Bugfix] Preserve benchmark metric sample counts in results (#7624)
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-16 08:39:01 -07:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
ZacheryAU
|
f062124ba4
|
[Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242)
|
2026-09-14 15:25:59 -07:00 |
|
|
Zhou TaichangandClaude Opus 5
|
aff7d64948
|
[Rebase] Rebase to vLLM 0.29.0 (#7230)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-10 12:08:28 +08:00 |
|
|
tlysanhuo
|
7c2e30afd3
|
[Bugfix] Bound omni benchmark per-request timeout to 15 min by default (#7130)
Signed-off-by: tly <2200895168@qq.com>
|
2026-09-08 02:00:25 -07:00 |
|
|
ZacheryAU
|
b1ec136bd7
|
[Frontend] Add omni benchmark support for image and video endpoints (#4728)
|
2026-09-08 09:28:21 +08:00 |
|
|
|
5d7fdf9350
|
[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-05 08:20:21 +00:00 |
|
|
Gao Han
|
71748388f8
|
[Bugfix] Recover Omni benchmark TPOT from Stage 0 metrics (#6818)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-08-31 00:43:25 +08:00 |
|
|
Honghan Zhuandamy-why-3459
|
72a1ce488b
|
[Bugfix] Avoid invalid TPOT metrics (#6696)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-29 11:56:37 +00:00 |
|
|
NATURE
|
497c537c6f
|
[Benchmark] Add local OmniInteract realtime benchmark (#6522)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-08-25 15:32:58 +00:00 |
|
|
amy-why-3459
|
7cd826d28c
|
[Bugfix][MiniCPM-o] Align Daily-Omni offline loading and duplex soft-… (#6095)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-12 18:36:31 +08:00 |
|
|
Zhou TaichangandClaude Opus 5
|
2ce15ab7a0
|
[Rebase] Rebase to vllm 0.27.0 (#5976)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-11 15:23:46 +00:00 |
|
|
|
322600bfb2
|
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage (#5524)
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: psv666 <2693925048@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-11 14:53:49 +08:00 |
|
|
amy-why-3459andCursor
|
67aa6c55a4
|
[Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… (#5625)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-31 22:41:00 -07:00 |
|
|
ZacheryAU
|
778959797c
|
[Refactor] Centralize metrics related helpers to metrics/ (#5168)
|
2026-07-23 15:55:05 +00:00 |
|
|
Sy03andYueqian Lin
|
9eaca72382
|
[Perf][VoxCPM2] Add unified decode graph optimization (#4606)
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-07-04 05:30:48 +00:00 |
|
|
LHXuuu
|
991fb7408b
|
[BugFix][Ming-TTS] Improve Seed-TTS WER accuracy (#4859)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
|
2026-07-03 12:15:03 +02:00 |
|
|
Canlin Guo
|
a8b2bf11d2
|
[Feature] Support MOSS-TTS-Local-v1.5 Streaming (#4804)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-07-03 16:00:30 +08:00 |
|
|
Zhou Taichang
|
a560ed184d
|
[Rebase] Rebase to vllm v0.24.0 (#4709)
|
2026-06-30 19:41:06 +08:00 |
|
|
faceless void
|
11f6a0b72e
|
Make speech streaming default to SSE (#4679)
Signed-off-by: syd520zy <529477025@qq.com>
|
2026-06-30 02:17:24 +00:00 |
|
|
Canlin Guo
|
2e6c83c89c
|
[Model] Support MOSS-TTS-local-v1.5 (#4664)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-06-25 15:43:03 +08:00 |
|
|
amy-why-3459
|
d897852258
|
[BugFix] Fix the issue of incorrect generated tokens (#4461)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-06-17 02:31:48 +00:00 |
|
|
Zhou Taichang
|
7b837944a1
|
[Rebase] Rebase to vllm 0.23.0 (#4286)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-06-13 16:43:02 +00:00 |
|
|
FED4andGao Han
|
6ae355b9a9
|
[BugFix] Remove pydub dependency for Python 3.13 compatibility (#4035)
Signed-off-by: FED4 <feiyyfrank@outlook.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-06-09 20:45:57 -07:00 |
|
|
ZacheryAU
|
bfc7cedcf1
|
Benchmark data statistics for each stage of omni models (#3628)
Signed-off-by: ZacheryAU <70869627+ZacheryAU@users.noreply.github.com>
|
2026-06-04 21:43:35 +08:00 |
|
|
Zhang JianandCanlin Guo
|
b550709bba
|
[TTS][Model] support MOSS-TTS series (#3420)
Signed-off-by: Zhang <jianmusings@gmail.com>
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Signed-off-by: jian <jianmusings@gmail.com>
Signed-off-by: Canlin Guo <961750412@qq.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-06-02 15:46:01 +08:00 |
|
|
Yueqian LinandHongsheng Liu
|
f99e8b2d3c
|
[Bench] Add audio-streaming continuity metric for TTS (#3618)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-20 05:08:56 +00:00 |
|
|
Yueqian Lin
|
990566aef1
|
[Bugfix][TTS] Drop meaningless TTFT from speech-endpoint benchmarks (#3674)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-05-18 17:18:18 +08:00 |
|
|
amy-why-3459
|
ce621be29b
|
[BugFix] Modify the splicing method of streaming audio output. (#3438)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-05-12 11:56:10 +08:00 |
|
|
Zhou TaichangandYuanheng Zhao
|
7f2b1e9386
|
[Rebase] Rebase to vllm 0.20.0 (#3232)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
|
2026-04-30 09:56:59 +12:00 |
|
|
Yueqian Lin
|
39e3fd3d12
|
[Benchmark] Universal TTS benchmark: Qwen3-TTS + VoxCPM2 with 3 task types (voice-clone/default/design) (#2835)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-24 23:35:33 +08:00 |
|
|
amy-why-3459
|
227bab3038
|
[Benchmark]Omni-modality model accuracy benchmark(Daily-Omni & seed-tts-eval) (#2558)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-15 11:07:35 +08:00 |
|
|
Alex Brooks
|
cf1fcd5acf
|
[CI/BugFix] Fix Flaky Test for Qwen Omni Perf (#2754)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-04-14 20:49:57 +08:00 |
|
|
Dnoob
|
7e7efdd1ab
|
[Bugfix] Fix benchmark Total input tokens for multimodal requests (#2540) (#2549)
Signed-off-by: Dnoob <dxpouo@gmail.com>
|
2026-04-08 11:00:53 +00:00 |
|
|
Zhou Taichang
|
2804a85e58
|
[Rebase] Rebase to vllm v0.19.0 (#2475)
|
2026-04-04 15:03:32 +08:00 |
|
|
amy-why-3459
|
9f667ee151
|
[BugFix][Qwen3-Omni]Fixed the issue of incorrect answers for single words. (#2239)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-03-27 11:46:24 +08:00 |
|
|
NumberWan
|
7007217d4b
|
[Bugfix]: fixed ServerDisconnectedError in benchmark test (reapply #1683, fixes #1374) (#1841)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-03-21 11:41:02 +08:00 |
|
|
Yueqian Lin
|
f144f5effe
|
[Test] Add Qwen3-TTS nightly performance benchmark (#1700)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:07:47 +08:00 |
|
|
|
89b527e533
|
Dev/rebase v0170 (#1639)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-03-09 17:29:38 +08:00 |
|
|
Ekagra RanjanandHongsheng Liu
|
aa54569033
|
Add benchmark for v1/audio/speech non-streaming (#1408)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-27 14:31:52 +08:00 |
|
|
|
75770c9309
|
[Rebase] Rebase to vllm v0.16.0 (#1357)
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2026-02-13 18:05:07 +08:00 |
|
|
John Liu BUAA
|
f117a07271
|
[Bugfix] reused metrics to modify the API Server token statistics in Stream Response (#1301)
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com>
|
2026-02-12 17:24:01 +08:00 |
|
|
wangyuandwangyu31577
|
117d9bd122
|
[Bugfix] modify RTF use audio_e2e/audio_duration (#1157)
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
|
2026-02-04 14:07:46 +08:00 |
|