tzhouamandClaude Fable 5.1
b70207f57f
Adds benchmarks/tts/stream_latency_bench.py (AsyncOmni driver reusing the Qwen3-TTS example's prompt builder; --model override, warm-up/repeat, --init-only, per-chunk arrivals, peak RSS and per-process GPU memory) and benchmarks/tts/stream_latency_metrics.py (TTFA, underrun-free playback start, stall at TTFA, RTF streamed/total, chunk gaps, percentiles) with CPU unit tests. Results go under benchmarks/tts/edge_results/stream_latency/. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
756 B
756 B
Edge benchmark results
Committed JSON produced by the edge branch benchmarks (kept small; WAVs are never committed):
stream_latency/<model>/<deploy>/<timestamp>[_tag].json—stream_latency_bench.pyoutput (schema 1):meta(model, deploy config, git SHA, GPU),init(init_s, optional init timeline),resources(peak RSS, peak GPU MiB, sampling mode),requests[](per-chunk arrivals, TTFA, playback-start, stall at TTFA, RTF streamed / total) andsummary(p50/p90/max).init_profile/<timestamp>/summary.json—init_profile.pycomparison of initialization phases per configuration.hw_emulation/,scheduling/— per-work-package comparison tables.
Metric definitions live in benchmarks/tts/stream_latency_metrics.py.