Optimize Qwen-Image 2.1 attention and decode graph reuse (#7790)
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
This commit is contained in:
1 parent
f930348e79
commit
ab4cf24b3e
24 files changed
+1147
-414
No files matched your search
@@ -902,11 +902,6 @@ class OmniDiffusionConfig:
|
||||
|
||||
# Compilation
|
||||
enforce_eager: bool = False
|
||||
# Opt-in: capture fixed-shape KV-cache decode (denoising) steps into CUDA
|
||||
# graphs. Currently implemented by Qwen-Image-2.1's transformer; unsupported
|
||||
# configurations (SP/TP, ring, HSDP, dynamic LoRA, padded masks) log and
|
||||
# fall back to eager decode. Other models ignore this flag.
|
||||
enable_cuda_graph_decode: bool = False
|
||||
# Controls the generic compilation path used when a pipeline does not
|
||||
# provide its own setup_compile() implementation.
|
||||
diffusion_compile_granularity: str = "regional"
|
||||
|
||||
Reference in new issue
Block a user