0 Fork 0

Files

T

Yuanheng ZhaoandSamit 8bf849c399 Refactor CPU Offloading Backend Pattern (#1223 )

Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>

2026-02-12 17:29:55 +08:00

adding_diffusion_model.md

Refactor CPU Offloading Backend Pattern (#1223 )

2026-02-12 17:29:55 +08:00

adding_omni_model.md

[CI] Add pytest markers in config files. (#719 )

2026-01-14 20:35:26 +08:00

README.md

[docs] update adding models docs (#563 )

2025-12-31 13:42:11 +08:00

README.md

Adding a New Model

This section provides comprehensive guidance on how to add a new model to vLLM-Omni.

Documentation

Adding an Omni-Modality Model: Complete step-by-step guide using Qwen3-Omni as an example.
Adding a Diffusion Model: Complete step-by-step guide using Qwen/Qwen-Image-Edit as an example.

Quick Start

For a quick reference, see the Adding a New Multi-Stage Model Guide and Adding a New Diffusion Model Guide.