vllm-omni/docs/design/index.md

Design Documents

This section contains design documents and architecture specifications for vLLM-Omni.

Architecture Documents

• Architecture Overview

Feature Design Documents

• Disaggregated Inference
• Ray-based Execution
• Async Omni Output Materialization
• Diffusion Continuous Batching

Infrastructure Design Documents

• Prometheus Metrics

Module Design Documents

• AR Module
• DIT Module
• Entrypoint Module