[Model] Reduce MOSS-TTS Local intermediate output overhead

Keep internal talker control outputs FINAL_ONLY while codec audio remains incremental. Reapply pipeline sampling constraints after default streaming coercion, log routine coercions at debug level, and cover explicit/default parameters with regression tests. Document matched high-concurrency statistics settings.

Signed-off-by: Sy03 <1370724210@qq.com>
This commit is contained in:
Sy03 committed 2026-09-08 01:15:46 +08:00
1 parent dcd6588a36
commit 55855fee9c
6 files changed
+66 -7

No files matched your search

+2 -2
View File
@@ -868,9 +868,9 @@ def maybe_coerce_to_message_type(params: SamplingParams, is_streaming: bool):
if params.output_kind == target_type:
return params
elif is_streaming and params.output_kind == RequestOutputKind.FINAL_ONLY:
logger.warning("Request appears to be streaming, but got request type final only!")
logger.debug("Coercing FINAL_ONLY output to DELTA for streaming")
elif not is_streaming and params.output_kind == RequestOutputKind.DELTA:
logger.warning("Request appears to not be streaming, but got request type delta!")
logger.debug("Coercing DELTA output to FINAL_ONLY for non-streaming")
if not params.skip_clone:
params = params.clone()