[Perf][Diffusion] Add configurable H3 VAE stacked tiling

Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
This commit is contained in:
hsliuustc0106 committed 2026-09-03 17:17:59 +00:00
1 parent dff28e6867
commit b188874539
12 files changed
+210 -5

No files matched your search

@@ -120,10 +120,18 @@ Additional requirements:
| Parameter | Type | Default | Description |
|-----------|------|---------|-------------|
| `vae_use_tiling` | bool | False | Must be set to `True` when using VAE patch parallelism. |
| `vae_stack_tiling` | `"auto"` \| `"true"` \| `"false"` | `"false"` | For VAEs with native support (currently MiniMax H3), batch local decoder tiles into fewer model calls. `"auto"` enables it when the request has at least two tiles per VAE-parallel rank. |
!!! note "Automatic VAE Tiling"
When `vae_patch_parallel_size > 1` and the model has a distributed VAE (`DistributedVaeMixin`), the system automatically sets `vae_use_tiling=True` if not already enabled.
!!! tip "MiniMax H3 stacked tiling"
MiniMax H3 supports lossless native stacked tiling. Enable it with
`--vae-stack-tiling auto` (or `true`) to batch each rank's spatial tiles
into one decoder call per temporal window. `auto` keeps the sequential
path for shapes that do not provide multiple tiles per rank, while
`false` remains the default to avoid increasing the VAE activation peak.
---
## Spatially-Sharded Decode (Wan)