0 Fork 0

Files

T

LancerandDidan Deng 328de586aa [Feat] support for multi-block layerwise offloading, fix top-level parameters/buffers staying on CPU (#1486 )

Signed-off-by: Lancer <maruixiang6688@gmail.com>
Signed-off-by: Lancer <402430575@qq.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>

2026-04-06 11:49:35 +08:00

adding_diffusion_model.md

[Feat] support for multi-block layerwise offloading, fix top-level parameters/buffers staying on CPU (#1486 )

2026-04-06 11:49:35 +08:00

adding_omni_model.md

[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908 )

2026-03-18 17:33:53 +08:00

adding_quantization_model.md

[Core] Unified quantization framework (#1764 )

2026-03-24 18:56:55 +08:00

adding_tts_model.md

[Bugfix] Remove duplicated config keyword max batch size (#1851 )

2026-03-20 16:13:24 +08:00

README.md

[docs] update adding models docs (#563 )

2025-12-31 13:42:11 +08:00

README.md

Adding a New Model

This section provides comprehensive guidance on how to add a new model to vLLM-Omni.

Documentation

Adding an Omni-Modality Model: Complete step-by-step guide using Qwen3-Omni as an example.
Adding a Diffusion Model: Complete step-by-step guide using Qwen/Qwen-Image-Edit as an example.

Quick Start

For a quick reference, see the Adding a New Multi-Stage Model Guide and Adding a New Diffusion Model Guide.