Roger WangandGao Han
a5800cd2c2
Signed-off-by: Roger Wang <hey@rogerw.io> Signed-off-by: Gao Han <gaohan19@huawei.com> Co-authored-by: Gao Han <gaohan19@huawei.com>
14 lines
377 B
Markdown
14 lines
377 B
Markdown
# Design Documents
|
|
|
|
This section contains design documents and architecture specifications for vLLM-Omni.
|
|
|
|
## Architecture Documents
|
|
|
|
- [Architecture Overview](architecture_overview.md)
|
|
- [vLLM-Omni Software Design Document](vllm_omni_design.md)
|
|
- [Multi-Request Streaming](mrs_design.md)
|
|
|
|
## API Design Documentation
|
|
|
|
- [vLLM-Omni API Design Documentation](api_design_doc.md)
|