[Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
This commit is contained in:
1 parent
d3c47efc4f
commit
a28ded243f
7 files changed
+135
-8
No files matched your search
@@ -15,6 +15,7 @@ connectors:
|
||||
name: SharedMemoryConnector
|
||||
extra:
|
||||
latent_chunk_size: 25
|
||||
initial_latent_chunk_size: 4
|
||||
latent_left_context: 0
|
||||
|
||||
stages:
|
||||
|
||||
@@ -23,6 +23,7 @@ connectors:
|
||||
name: SharedMemoryConnector
|
||||
extra:
|
||||
latent_chunk_size: 25
|
||||
initial_latent_chunk_size: 4
|
||||
latent_left_context: 0
|
||||
|
||||
stages:
|
||||
|
||||
Reference in new issue
Block a user