Signed-off-by: Semmer <semmer@live.cn> Signed-off-by: jader <yjader@foxmail.com> Signed-off-by: asukaqaq-s <1311722138@qq.com> Co-authored-by: asukaqaq-s <1311722138@qq.com> Co-authored-by: jader <yjader@foxmail.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
673 B
673 B
Design Documents
This section contains design documents and architecture specifications for vLLM-Omni.
Architecture Documents
Feature Design Documents
- Disaggregated Inference
- Ray-based Execution
- Adding Step Execution Support for Diffusion Pipelines
- Continuous Batching for Step-Wise Diffusion