[Perf] Support request-level batching for Wan2.2 pipelines (#5676)
Signed-off-by: nagisa-kun <1434936049@qq.com> Signed-off-by: nagisa <1434936049@qq.com>
This commit is contained in:
1 parent
d1e230c95b
commit
2a315e1a2d
18 files changed
+1871
-374
No files matched your search
@@ -88,9 +88,10 @@ class RequestBatchSamplingParamsKey:
|
||||
"""Request level Batch-compatibility key derived from ``OmniDiffusionSamplingParams``.
|
||||
|
||||
Only request-batch-wide fields belong here. Request-local values such as
|
||||
seeds, generators, latent tensors, timesteps, and pipeline-specific
|
||||
seeds, generators, latent tensors, timesteps, and request-local
|
||||
``extra_args`` are read per request from
|
||||
``DiffusionRequestBatch.sampling_params_list``.
|
||||
``DiffusionRequestBatch.sampling_params_list``. Structural ``extra_args``
|
||||
that affect batching are listed explicitly below.
|
||||
"""
|
||||
|
||||
# Spatial / temporal shape.
|
||||
@@ -131,6 +132,16 @@ class RequestBatchSamplingParamsKey:
|
||||
# the model and must remain distinct from explicit ``lossless``.
|
||||
quality: str | None = None
|
||||
|
||||
# Wan scheduler structure is carried through extra_args. Requests using
|
||||
# different solvers or flow shifts must not share a request batch.
|
||||
sample_solver: str | None = None
|
||||
flow_shift: float | None = None
|
||||
|
||||
# Pipeline-specific condition structure populated during preprocessing.
|
||||
# It prevents independently valid requests with incompatible conditions
|
||||
# from being admitted to the same request batch.
|
||||
condition_key: tuple[Any, ...] | None = None
|
||||
|
||||
# LoRA identity.
|
||||
lora_int_id: int | None = None
|
||||
lora_scale: float = 1.0
|
||||
|
||||
Reference in new issue
Block a user