diff --git a/docs/.nav.yml b/docs/.nav.yml index bdc11ec7c..40cad482b 100644 --- a/docs/.nav.yml +++ b/docs/.nav.yml @@ -43,6 +43,7 @@ nav: - Overview: features/README.md - Runtime and Stage Execution: - Execution Modes and Streaming: user_guide/diffusion/execution_modes.md + - Prefill-Decode Disaggregation (experimental): configuration/pd_disaggregation.md - Sleep Mode: features/sleep_mode.md - Quantization: - Overview: user_guide/quantization/overview.md diff --git a/docs/configuration/README.md b/docs/configuration/README.md index 09772ccd1..b59c29a7f 100644 --- a/docs/configuration/README.md +++ b/docs/configuration/README.md @@ -14,10 +14,6 @@ For introduction, please check [Introduction for stage config](./stage_configs.m - **[GPU Memory Calculation and Configuration](./gpu_memory_utilization.md)** - Guide on how to calculate memory requirements and set up `gpu_memory_utilization` for optimal performance -## Multi-Stage Recipes - -- **[Prefill-Decode Disaggregation](./pd_disaggregation.md)** - How to derive a PD-aware Qwen3-Omni stage config from the default config without introducing another bundled YAML - ## Optimization Features - **[Diffusion Features Overview](../user_guide/diffusion_features.md)** - Complete overview of all diffusion model features and supported models diff --git a/docs/configuration/pd_disaggregation.md b/docs/configuration/pd_disaggregation.md index 93c623ebd..cef12208f 100644 --- a/docs/configuration/pd_disaggregation.md +++ b/docs/configuration/pd_disaggregation.md @@ -1,4 +1,8 @@ -# Prefill-Decode (PD) Disaggregation +# Prefill-Decode (PD) Disaggregation (experimental) + +!!! warning "Experimental" + PD disaggregation support is experimental and currently documented only for + Qwen3-Omni. Its configuration and behavior may change without notice. PD disaggregation splits the Qwen3-Omni thinker into separate prefill and decode stages so prompt processing and token generation can run on different workers. diff --git a/docs/features/README.md b/docs/features/README.md index 0dee558a4..65e41756a 100644 --- a/docs/features/README.md +++ b/docs/features/README.md @@ -20,13 +20,19 @@ an implementation contract has a user-facing workflow. | Choose serial, batched, step-wise, or streaming diffusion execution | [Execution Modes and Streaming](../user_guide/diffusion/execution_modes.md) | [Diffusion Continuous Batching](../design/feature/diffusion_continuous_batching.md), [Async Diffusion Output](../design/feature/async_diffusion_output.md) | | Reclaim stage memory without restarting the server | [Sleep Mode](sleep_mode.md) | Runtime lifecycle behavior is documented in the user guide | +The [Prefill-Decode Disaggregation guide](../configuration/pd_disaggregation.md) +documents an experimental, Qwen3-Omni-specific stage configuration. Its +configuration and behavior may change without notice. + Some runtime designs are deliberately not promoted as standalone User Guide features yet: -- [Disaggregated Inference](../design/feature/disaggregated_inference.md) and +- Generic, OmniConnector-based + [Disaggregated Inference](../design/feature/disaggregated_inference.md) is not + yet a standalone User Guide feature. Its [OmniConnector implementations](../design/index.md#communication) describe - topology and transport contracts. Practical deployment configuration remains - under [Pipeline and deploy configurations](../configuration/stage_configs.md). + transport contracts, while practical connector configuration remains under + [Pipeline and deploy configurations](../configuration/stage_configs.md). - [Async Chunk](../design/feature/async_chunk.md) and [Async Omni Output Materialization](../design/feature/omni_async_output_materialization.md) are model- and pipeline-dependent. Use the selected model's deploy