diff --git a/docs/.nav.yml b/docs/.nav.yml index da3c10ecf..d647fb27c 100644 --- a/docs/.nav.yml +++ b/docs/.nav.yml @@ -71,7 +71,7 @@ nav: - Hybrid Sharded Data Parallel: user_guide/diffusion/parallelism/hsdp.md - Sequence Parallel: user_guide/diffusion/parallelism/sequence_parallel.md - Tensor Parallel: user_guide/diffusion/parallelism/tensor_parallel.md - - VAE Parallelism: user_guide/diffusion/parallelism/vae_parallel.md + - VAE Parallel: user_guide/diffusion/parallelism/vae_parallel.md - Attention Backends: user_guide/diffusion/attention_backends.md - Regional Compilation: user_guide/diffusion/regional_compilation.md - Frame Interpolation: user_guide/diffusion/frame_interpolation.md @@ -123,7 +123,7 @@ nav: - Pipeline Parallel: design/feature/pipeline_parallel.md - Sequence Parallel: design/feature/sequence_parallel.md - Tensor Parallel: design/feature/tensor_parallel.md - - VAE Parallelism: design/feature/vae_parallel.md + - VAE Parallel: design/feature/vae_parallel.md - Attention Optimization: - Skip-Softmax: design/feature/skip_softmax.md - Cache-DiT: design/feature/cache_dit.md diff --git a/docs/design/architecture_overview.md b/docs/design/architecture_overview.md index a121069d9..39aaff300 100644 --- a/docs/design/architecture_overview.md +++ b/docs/design/architecture_overview.md @@ -398,7 +398,7 @@ the source for configuration, compatibility, and implementation details. * **Composable parallelism:** Diffusion stages can combine [CFG-Parallel](feature/cfg_parallel.md), [Expert Parallel](feature/expert_parallel.md), [HSDP](feature/hsdp.md), [Pipeline Parallel](feature/pipeline_parallel.md), [Sequence Parallel](feature/sequence_parallel.md), - [Tensor Parallel](feature/tensor_parallel.md), and [VAE Parallelism](feature/vae_parallel.md) + [Tensor Parallel](feature/tensor_parallel.md), and [VAE Parallel](feature/vae_parallel.md) according to the pipeline and hardware topology. * **Attention and cache acceleration:** [Skip-Softmax](feature/skip_softmax.md), [Cache-DiT](feature/cache_dit.md), and [TeaCache](feature/teacache.md) diff --git a/docs/design/feature/vae_parallel.md b/docs/design/feature/vae_parallel.md index 65b8d92b0..8a202ac7e 100644 --- a/docs/design/feature/vae_parallel.md +++ b/docs/design/feature/vae_parallel.md @@ -1,4 +1,4 @@ -# VAE Parallelism +# VAE Parallel This document defines the VAE parallelism strategy contract and describes how to add a strategy to a diffusion model. Tile/patch parallelism is the portable diff --git a/docs/design/index.md b/docs/design/index.md index eca3ecd3b..a5b5526df 100644 --- a/docs/design/index.md +++ b/docs/design/index.md @@ -48,7 +48,7 @@ implementation contract; it is not, by itself, a general support claim. - [Pipeline Parallel](feature/pipeline_parallel.md) - [Sequence Parallel](feature/sequence_parallel.md) - [Tensor Parallel](feature/tensor_parallel.md) -- [VAE Parallelism](feature/vae_parallel.md) +- [VAE Parallel](feature/vae_parallel.md) #### Attention optimization diff --git a/docs/user_guide/diffusion/parallelism/overview.md b/docs/user_guide/diffusion/parallelism/overview.md index 362492f45..feaa1df23 100644 --- a/docs/user_guide/diffusion/parallelism/overview.md +++ b/docs/user_guide/diffusion/parallelism/overview.md @@ -10,7 +10,7 @@ This guide covers the parallelism methods in vLLM-Omni for speeding up diffusion | **[Sequence Parallelism](sequence_parallel.md)** | Splits sequence dimension across GPUs (Ulysses-SP, Ring-Attention, or hybrid) for high-resolution images and videos | | **[CFG-Parallel](cfg_parallel.md)** | Runs CFG positive/negative branches on separate GPUs for ~1.8x speedup on guided generation | | **[Pipeline Parallelism](pipeline_parallel.md)** | Splits the denoising transformer block-wise across sequential GPU stages to reduce per-GPU model memory | -| **[VAE Parallelism](vae_parallel.md)** | Distributes VAE decode spatially across GPUs to reduce peak VAE memory | +| **[VAE Parallel](vae_parallel.md)** | Distributes VAE decode spatially across GPUs to reduce peak VAE memory | | **[HSDP](hsdp.md)** | Shards full model weights via PyTorch FSDP2 to enable large-model inference on memory-constrained GPUs | | **[Expert Parallelism](expert_parallel.md)** | Shards MoE expert blocks across GPUs for MoE models (e.g. HunyuanImage3.0) | diff --git a/docs/user_guide/diffusion/parallelism/vae_parallel.md b/docs/user_guide/diffusion/parallelism/vae_parallel.md index bb3aca513..1ed0debd3 100644 --- a/docs/user_guide/diffusion/parallelism/vae_parallel.md +++ b/docs/user_guide/diffusion/parallelism/vae_parallel.md @@ -1,4 +1,4 @@ -# VAE Parallelism Guide +# VAE Parallel Guide ## Table of Content diff --git a/docs/user_guide/diffusion_features.md b/docs/user_guide/diffusion_features.md index e2b42916e..943dc9f38 100644 --- a/docs/user_guide/diffusion_features.md +++ b/docs/user_guide/diffusion_features.md @@ -61,7 +61,7 @@ Memory optimization methods help reduce GPU memory usage, enabling inference on |--------|-------------|----------| | **[CPU Offload](diffusion/cpu_offload.md)** | Offloads model components to CPU memory | Limited VRAM, large models on consumer GPUs | | **[Quantization](quantization/overview.md)** | Reduces transformer stages from BF16 to FP8/INT8/etc. | Limited VRAM, minimal accuracy loss | -| **[VAE Parallelism](diffusion/parallelism/vae_parallel.md)** | Distributes VAE decode work across GPUs | High-resolution generation with reduced VAE memory peak | +| **[VAE Parallel](diffusion/parallelism/vae_parallel.md)** | Distributes VAE decode work across GPUs | High-resolution generation with reduced VAE memory peak | ### Extensions