docs/design/index.md

# Design Documents

This section contains design documents and architecture specifications for vLLM-Omni.

## Architecture Documents

- [Architecture Overview](architecture_overview.md)

## Feature Design Documents

- [Disaggregated Inference](feature/disaggregated_inference.md)
- [Ray-based Execution](feature/ray_based_execution.md)
- [Async Omni Output Materialization](feature/omni_async_output_materialization.md)
- [Diffusion Continuous Batching](feature/diffusion_continuous_batching.md)

## Infrastructure Design Documents

- [Prometheus Metrics](metrics.md)

## Module Design Documents

- [AR Module](module/ar_module.md)
- [DIT Module](module/dit_module.md)
- [Entrypoint Module](module/entrypoint_module.md)
[Docs] Setup Documentation System and Re-organize Dependencies (#49 ) 2025-11-15 21:45:43 +08:00			`# Design Documents`

[Doc] Misc documentation polishing (#98 ) 2025-11-29 04:42:39 -08:00			`This section contains design documents and architecture specifications for vLLM-Omni.`
[Docs] Setup Documentation System and Re-organize Dependencies (#49 ) 2025-11-15 21:45:43 +08:00
			`## Architecture Documents`

			`- [Architecture Overview](architecture_overview.md)`
update docs/readme.md and design folder (#234 ) 2025-12-08 16:24:16 +08:00
			`## Feature Design Documents`

[Doc] fix docs Feature Design and Module Design (#283 ) 2025-12-12 01:52:53 -05:00			`- [Disaggregated Inference](feature/disaggregated_inference.md)`
update desgin docs (#269 ) 2025-12-10 21:22:34 -05:00			`- [Ray-based Execution](feature/ray_based_execution.md)`
[Doc] Document async Omni output materialization (#5610 ) 2026-08-04 14:50:38 +08:00			`- [Async Omni Output Materialization](feature/omni_async_output_materialization.md)`
[docs] consolidate diffusion execution modes (#5599 ) 2026-08-05 22:41:18 +08:00			`- [Diffusion Continuous Batching](feature/diffusion_continuous_batching.md)`
update docs/readme.md and design folder (#234 ) 2025-12-08 16:24:16 +08:00
[Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:* (#3576 ) 2026-06-01 20:20:48 +08:00			`## Infrastructure Design Documents`

			`- [Prometheus Metrics](metrics.md)`

update docs/readme.md and design folder (#234 ) 2025-12-08 16:24:16 +08:00			`## Module Design Documents`

[Doc] fix docs Feature Design and Module Design (#283 ) 2025-12-12 01:52:53 -05:00			`- [AR Module](module/ar_module.md)`
			`- [DIT Module](module/dit_module.md)`
			`- [Entrypoint Module](module/entrypoint_module.md)`