Optimize Qwen-Image 2.1 attention and decode graph reuse (#7790)

Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
This commit is contained in:
Tianyu Guo authored and GitHub committed 2026-09-18 19:37:19 +08:00
1 parent f930348e79
commit ab4cf24b3e
24 files changed
+1147 -414

No files matched your search

-5
View File
@@ -902,11 +902,6 @@ class OmniDiffusionConfig:
# Compilation
enforce_eager: bool = False
# Opt-in: capture fixed-shape KV-cache decode (denoising) steps into CUDA
# graphs. Currently implemented by Qwen-Image-2.1's transformer; unsupported
# configurations (SP/TP, ring, HSDP, dynamic LoRA, padded masks) log and
# fall back to eager decode. Other models ignore this flag.
enable_cuda_graph_decode: bool = False
# Controls the generic compilation path used when a pipeline does not
# provide its own setup_compile() implementation.
diffusion_compile_granularity: str = "regional"