e49fbd8a2d
Signed-off-by: Semmer <semmer@live.cn> Signed-off-by: jader <yjader@foxmail.com> Signed-off-by: asukaqaq-s <1311722138@qq.com> Co-authored-by: asukaqaq-s <1311722138@qq.com> Co-authored-by: jader <yjader@foxmail.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
21 lines
673 B
Markdown
21 lines
673 B
Markdown
# Design Documents
|
|
|
|
This section contains design documents and architecture specifications for vLLM-Omni.
|
|
|
|
## Architecture Documents
|
|
|
|
- [Architecture Overview](architecture_overview.md)
|
|
|
|
## Feature Design Documents
|
|
|
|
- [Disaggregated Inference](feature/disaggregated_inference.md)
|
|
- [Ray-based Execution](feature/ray_based_execution.md)
|
|
- [Adding Step Execution Support for Diffusion Pipelines](feature/diffusion_step_execution.md)
|
|
- [Continuous Batching for Step-Wise Diffusion](feature/diffusion_continuous_batching.md)
|
|
|
|
## Module Design Documents
|
|
|
|
- [AR Module](module/ar_module.md)
|
|
- [DIT Module](module/dit_module.md)
|
|
- [Entrypoint Module](module/entrypoint_module.md)
|