vllm-omni

0 Fork 0

Files

T

tzhouamandClaude Fable 5.1 c893b638ad [Edge][WP5] Accumulate per-step codec delta rows (DELTA mode delivers only the newest row)

Measured after the DELTA fix: 53 engine outputs for 52 rows, but the client
still received everything at once because each per-step payload is the newest
row only and the row alignment treated it as a cumulative snapshot (one yield
at the first row, one at the end). accumulate_codec_rows folds delta rows and
the final consolidated matrix into one growing matrix; unit test drives the
generator with per-step deltas and asserts one yield per step.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-09 16:45:24 +08:00

cli

[Edge][WP1] Add edge deploy profile and deploy_profile selector

2026-09-09 10:27:33 +08:00

duplex

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196 )

2026-09-05 08:20:21 +00:00

openai

[Edge][WP5] Accumulate per-step codec delta rows (DELTA mode delivers only the newest row)

2026-09-09 16:45:24 +08:00

openpi

[Core][Frontend] Support request-level batching for diffusion pipelines (#4079 )