[LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk> Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
1 parent
a9e2117f5e
commit
86fcfe95f1
23 files changed
+1957
-200
No files matched your search
@@ -92,6 +92,13 @@ class SupportsStepExecution(Protocol):
|
||||
``prepare_encode()`` (one-time request setup), ``denoise_step()``
|
||||
(one denoise forward), ``step_scheduler()`` (one scheduler update),
|
||||
and ``post_decode()`` (final decode).
|
||||
|
||||
A pipeline may additionally set the optional class attribute
|
||||
``supports_chunk_step_grouping = True`` to declare that its request state
|
||||
may advance through every denoise step of its current chunk without a
|
||||
serving-scheduler cycle in between (a capability, not a policy: the runner
|
||||
that owns the scheduling decision chooses whether to group steps). It is
|
||||
optional so it does not become part of the runtime protocol check.
|
||||
"""
|
||||
|
||||
supports_step_execution: ClassVar[bool] = True
|
||||
|
||||
Reference in new issue
Block a user