vllm-omni/docs/design/index.md

Design Documents

This section contains design documents and architecture specifications for vLLM-Omni.

Architecture Documents

• Architecture Overview
• vLLM-Omni Software Design Document

Feature Design Documents

• Multi-Request Streaming
• Omni Connector Design

Module Design Documents

• AR Module Design
• DIT Module Design
• Entrypoint Module Design