anodyine/vllm-omni

0 Fork 0

Files

T

History

a3903810fe [Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383 )

Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-04-19 14:36:00 +12:00

adding_diffusion_model.md

[Feat] support for multi-block layerwise offloading, fix top-level parameters/buffers staying on CPU (#1486 )

2026-04-06 11:49:35 +08:00

adding_omni_model.md

[Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383 )

2026-04-19 14:36:00 +12:00

adding_quantization_model.md

[Core] Unified quantization framework (#1764 )

2026-03-24 18:56:55 +08:00

adding_tts_model.md

[Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383 )

2026-04-19 14:36:00 +12:00

README.md

[docs] update adding models docs (#563 )

2025-12-31 13:42:11 +08:00

README.md

Adding a New Model

This section provides comprehensive guidance on how to add a new model to vLLM-Omni.

Documentation

Adding an Omni-Modality Model: Complete step-by-step guide using Qwen3-Omni as an example.
Adding a Diffusion Model: Complete step-by-step guide using Qwen/Qwen-Image-Edit as an example.

Quick Start

For a quick reference, see the Adding a New Multi-Stage Model Guide and Adding a New Diffusion Model Guide.