0 Fork 0

Files

T

tzhouamandClaude Fable 5.1 285db2fa3c edge results: WP1 edge-profile stream latency (0.6B/1.7B) + init timelines

1.7B: TTFA p50 43.9 ms, playback_start 43.9 ms, stall 0 (baseline 32.0 / 116.2 / 84.7).
0.6B: TTFA p50 46.1 ms, playback_start 46.1 ms, stall 0 (baseline 27.8 / 95.4 / 67.3).
RTF unchanged (~0.1). Measured on L20X via gpu run --gpus 1 (canhazgpu).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-09 11:21:48 +08:00

stream_latency

edge results: WP1 edge-profile stream latency (0.6B/1.7B) + init timelines

2026-09-09 11:21:48 +08:00

README.md

[Edge][WP0] Add offline streaming-latency benchmark for chunked TTS

2026-09-09 10:24:53 +08:00

README.md

Edge benchmark results

Committed JSON produced by the edge branch benchmarks (kept small; WAVs are never committed):

stream_latency/<model>/<deploy>/<timestamp>[_tag].json — stream_latency_bench.py output (schema 1): meta (model, deploy config, git SHA, GPU), init (init_s, optional init timeline), resources (peak RSS, peak GPU MiB, sampling mode), requests[] (per-chunk arrivals, TTFA, playback-start, stall at TTFA, RTF streamed / total) and summary (p50/p90/max).
init_profile/<timestamp>/summary.json — init_profile.py comparison of initialization phases per configuration.
hw_emulation/, scheduling/ — per-work-package comparison tables.

Metric definitions live in benchmarks/tts/stream_latency_metrics.py.