2025-11-15 21:45:43 +08:00
|
|
|
# Design Documents
|
|
|
|
|
|
2025-11-29 04:42:39 -08:00
|
|
|
This section contains design documents and architecture specifications for vLLM-Omni.
|
2025-11-15 21:45:43 +08:00
|
|
|
|
|
|
|
|
## Architecture Documents
|
|
|
|
|
|
|
|
|
|
- [Architecture Overview](architecture_overview.md)
|
2025-12-08 16:24:16 +08:00
|
|
|
|
|
|
|
|
## Feature Design Documents
|
|
|
|
|
|
|
|
|
|
- [Multi-Request Streaming](feature/multi_request_streaming_design.md)
|
|
|
|
|
- [Omni Connector Design](feature/omni_connector_design.md)
|
2025-12-10 21:22:34 -05:00
|
|
|
- [Ray-based Execution](feature/ray_based_execution.md)
|
2025-12-08 16:24:16 +08:00
|
|
|
|
|
|
|
|
## Module Design Documents
|
|
|
|
|
|
|
|
|
|
- [AR Module Design](module/ar_module_design.md)
|
|
|
|
|
- [DIT Module Design](module/dit_module_design.md)
|
|
|
|
|
- [Entrypoint Module Design](module/entrypoint_module_design.md)
|
