From a5ee63fb1fbb484c83595597d3158365d3576d07 Mon Sep 17 00:00:00 2001 From: Hongsheng Liu Date: Thu, 6 Aug 2026 16:36:16 +0800 Subject: [PATCH] docs: restore quantization overview page Signed-off-by: Hongsheng Liu --- docs/.nav.yml | 2 +- .../ci/test_examples/l4_functionality_tests.inc.md | 2 +- docs/design/feature/quantization.md | 2 +- docs/user_guide/diffusion_features.md | 6 +++--- docs/user_guide/quantization/{index.md => overview.md} | 0 mkdocs.yml | 2 +- 6 files changed, 7 insertions(+), 7 deletions(-) rename docs/user_guide/quantization/{index.md => overview.md} (100%) diff --git a/docs/.nav.yml b/docs/.nav.yml index a3fd37c53..ca17d550d 100644 --- a/docs/.nav.yml +++ b/docs/.nav.yml @@ -73,7 +73,7 @@ nav: - Custom Pipeline: features/custom_pipeline.md - Execution Modes: user_guide/diffusion/execution_modes.md - Quantization: - - Quantization: user_guide/quantization/index.md + - Quantization: user_guide/quantization/overview.md - Online Quantization: user_guide/quantization/online.md - Quantized KV Cache: user_guide/quantization/quantized_kvcache.md - FP8 W8A8: user_guide/quantization/fp8.md diff --git a/docs/contributing/ci/test_examples/l4_functionality_tests.inc.md b/docs/contributing/ci/test_examples/l4_functionality_tests.inc.md index 77215f578..5e65d2f48 100644 --- a/docs/contributing/ci/test_examples/l4_functionality_tests.inc.md +++ b/docs/contributing/ci/test_examples/l4_functionality_tests.inc.md @@ -1,6 +1,6 @@ **Scope** -For diffusion models, the L4 functionality test covers all or common *diffusion features* that are supported by this model, including several [parallelism acceleration methods](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/parallelism_acceleration/), [CPU offloading](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/cpu_offload/), [TeaCache](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/teacache/) and [Cache-DiT](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/cache_dit_acceleration/) cache backends, [quantization methods](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/quantization/). +For diffusion models, the L4 functionality test covers all or common *diffusion features* that are supported by this model, including several [parallelism acceleration methods](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/parallelism_acceleration/), [CPU offloading](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/cpu_offload/), [TeaCache](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/teacache/) and [Cache-DiT](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/diffusion/cache_dit_acceleration/) cache backends, [quantization methods](https://docs.vllm.ai/projects/vllm-omni/en/latest/user_guide/quantization/overview/). **Test Case Design** diff --git a/docs/design/feature/quantization.md b/docs/design/feature/quantization.md index 5c13bcd75..37dd5e26b 100644 --- a/docs/design/feature/quantization.md +++ b/docs/design/feature/quantization.md @@ -3,7 +3,7 @@ This document describes the quantization architecture in vLLM-Omni and the extension points for contributors. For user-facing configuration, supported hardware, and method-specific instructions, see the -[quantization user guide](../../user_guide/quantization/index.md). +[quantization user guide](../../user_guide/quantization/overview.md). ## Goals and scope diff --git a/docs/user_guide/diffusion_features.md b/docs/user_guide/diffusion_features.md index 29997bffb..83bc3643e 100644 --- a/docs/user_guide/diffusion_features.md +++ b/docs/user_guide/diffusion_features.md @@ -60,7 +60,7 @@ Memory optimization methods help reduce GPU memory usage, enabling inference on | Method | Description | Best For | |--------|-------------|----------| | **[CPU Offload](diffusion/cpu_offload.md)** | Offloads model components to CPU memory | Limited VRAM, large models on consumer GPUs | -| **[Quantization](quantization/index.md)** | Reduces transformer stages from BF16 to FP8/INT8/etc. | Limited VRAM, minimal accuracy loss | +| **[Quantization](quantization/overview.md)** | Reduces transformer stages from BF16 to FP8/INT8/etc. | Limited VRAM, minimal accuracy loss | | **[VAE Parallelism](diffusion/parallelism/vae_parallelism.md)** | Distributes VAE decode work across GPUs | High-resolution generation with reduced VAE memory peak | ### Extensions @@ -105,7 +105,7 @@ The following tables show which models support each feature: > Notes: > 1. CPU Offload has two methods: Module-wise (default for models with DiT + text encoder) and Layerwise. The tables below show **Layerwise support** only. Split models like Cosmos3 (no separate text encoder) swap their reasoner/generator components for module-wise offload; see the [CPU Offload Guide](diffusion/cpu_offload.md). -> 2. The **💾Quantization** column is collapsed for readability. See [Quantization](quantization/index.md) for per-method and per-model support details. +> 2. The **💾Quantization** column is collapsed for readability. See [Quantization](quantization/overview.md) for per-method and per-model support details. ### ImageGen @@ -276,7 +276,7 @@ Measured on NVIDIA H800: - **[CPU Offload Guide](diffusion/cpu_offload.md)** - Offload model components to CPU, reduce GPU memory usage - **[VAE Parallelism Guide](diffusion/parallelism/vae_parallelism.md)** - Distribute VAE decode work across GPUs for high-resolution images and videos -- **[Quantization](quantization/index.md)** - Quantization methods for diffusion, multi-stage omni/TTS, and multi-stage diffusion models +- **[Quantization](quantization/overview.md)** - Quantization methods for diffusion, multi-stage omni/TTS, and multi-stage diffusion models **Extensions:** diff --git a/docs/user_guide/quantization/index.md b/docs/user_guide/quantization/overview.md similarity index 100% rename from docs/user_guide/quantization/index.md rename to docs/user_guide/quantization/overview.md diff --git a/mkdocs.yml b/mkdocs.yml index 725aa9c61..fd97b9b37 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -76,7 +76,7 @@ plugins: user_guide/diffusion/request_batching.md: user_guide/diffusion/execution_modes.md user_guide/diffusion/step_execution.md: user_guide/diffusion/execution_modes.md user_guide/diffusion/cpu_offload_diffusion.md: user_guide/diffusion/cpu_offload.md - user_guide/quantization/overview.md: user_guide/quantization/index.md + user_guide/quantization/index.md: user_guide/quantization/overview.md design/feature/diffusion_request_level_batching.md: design/feature/diffusion_continuous_batching.md design/feature/diffusion_step_execution.md: design/feature/diffusion_continuous_batching.md - glightbox