[Diffusion] Prepare HunyuanImage3 for Scheduler-managed paged KV cache (#5541)

Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
authored and GitHub committed 2026-08-10 08:48:56 +08:00
1 parent 615de4e041
commit 6ae7ff7846
24 files changed
+1728 -277

No files matched your search

+3
View File
@@ -77,6 +77,9 @@ class StepRequestState:
sampling: OmniDiffusionSamplingParams
prompt: OmniPromptType | None = None
kv_sender_info: dict | None = None
# Opaque model-owned preprocessing result. Scheduler-owned Diffusion KV
# request state is removed before this Worker state is built.
prepared_layout: Any | None = None
# ── Encoded prompts (set once by prepare_encode) ──
prompt_embeds: torch.Tensor | None = None