2025-11-28 11:03:52 +08:00
# Supported Models
vLLM-Omni supports unified multimodal comprehension and generation models across various tasks.
## Model Implementation
2025-12-06 17:41:03 +08:00
If vLLM-Omni natively supports a model, its implementation can be found in <gh-file:vllm_omni/model_executor/models> and <gh-file:vllm_omni/diffusion/models>.
2025-11-28 11:03:52 +08:00
2025-12-11 17:42:05 +08:00
## List of Supported Models for Nvidia GPU / AMD GPU
2025-11-28 11:03:52 +08:00
<style>
th {
white-space: nowrap;
min-width: 0 !important;
}
</style>
| Architecture | Models | Example HF Models |
|--------------|--------|-------------------|
2025-12-01 08:36:04 +08:00
| `Qwen3OmniMoeForConditionalGeneration` | Qwen3-Omni | `Qwen/Qwen3-Omni-30B-A3B-Instruct` |
2025-11-28 18:07:44 +08:00
| `Qwen2_5OmniForConditionalGeneration` | Qwen2.5-Omni | `Qwen/Qwen2.5-Omni-7B` , `Qwen/Qwen2.5-Omni-3B` |
2025-12-31 13:47:35 +08:00
| `BagelForConditionalGeneration` | BAGEL (DiT-only) | `ByteDance-Seed/BAGEL-7B-MoT` |
2026-02-09 22:03:44 +08:00
| `HunyuanImage3ForCausalMM` | HunyuanImage3.0 (DiT-only) | `tencent/HunyuanImage-3.0` , `tencent/HunyuanImage-3.0-Instruct` |
2025-11-28 18:07:44 +08:00
| `QwenImagePipeline` | Qwen-Image | `Qwen/Qwen-Image` |
2026-01-06 15:06:03 +08:00
| `QwenImagePipeline` | Qwen-Image-2512 | `Qwen/Qwen-Image-2512` |
2025-12-08 16:19:27 +08:00
| `QwenImageEditPipeline` | Qwen-Image-Edit | `Qwen/Qwen-Image-Edit` |
2025-12-18 18:16:32 +08:00
| `QwenImageEditPlusPipeline` | Qwen-Image-Edit-2509 | `Qwen/Qwen-Image-Edit-2509` |
2025-12-20 22:51:50 +08:00
| `QwenImageLayeredPipeline` | Qwen-Image-Layered | `Qwen/Qwen-Image-Layered` |
2026-02-04 15:40:30 +08:00
| `GlmImagePipeline` | GLM-Image | `zai-org/GLM-Image` |
2025-12-03 10:16:36 +08:00
|`ZImagePipeline` | Z-Image | `Tongyi-MAI/Z-Image-Turbo` |
2025-12-25 01:45:13 -07:00
| `WanPipeline` | Wan2.2-T2V, Wan2.2-TI2V | `Wan-AI/Wan2.2-T2V-A14B-Diffusers` , `Wan-AI/Wan2.2-TI2V-5B-Diffusers` |
| `WanImageToVideoPipeline` | Wan2.2-I2V | `Wan-AI/Wan2.2-I2V-A14B-Diffusers` |
2026-03-05 23:31:48 +08:00
| `LTX2Pipeline` | LTX-2-T2V | `Lightricks/LTX-2` |
| `LTX2ImageToVideoPipeline` | LTX-2-I2V | `Lightricks/LTX-2` |
2026-03-04 14:17:15 +08:00
| `HeliosPipeline` , `HeliosPyramidPipeline` | Helios | `BestWishYsh/Helios-Base` , `BestWishYsh/Helios-Mid` , `BestWishYsh/Helios-Distilled` |
2025-12-19 17:35:34 +05:30
| `OvisImagePipeline` | Ovis-Image | `OvisAI/Ovis-Image` |
2025-12-18 23:35:27 +08:00
|`LongcatImagePipeline` | LongCat-Image | `meituan-longcat/LongCat-Image` |
2025-12-23 15:09:25 +08:00
|`LongCatImageEditPipeline` | LongCat-Image-Edit | `meituan-longcat/LongCat-Image-Edit` |
2025-12-27 21:51:03 +08:00
|`StableDiffusion3Pipeline` | Stable-Diffusion-3 | `stabilityai/stable-diffusion-3.5-medium` |
2026-03-05 00:54:59 +00:00
|`CosyVoice3Model` | CosyVoice3 | `FunAudioLLM/Fun-CosyVoice3-0.5B-2512` |
2026-03-04 22:52:56 +08:00
|`MammothModa2ForConditionalGeneration` | MammothModa2-Preview | `bytedance-research/MammothModa2-Preview` |
2026-01-16 16:32:28 +08:00
|`Flux2KleinPipeline` | FLUX.2-klein | `black-forest-labs/FLUX.2-klein-4B` , `black-forest-labs/FLUX.2-klein-9B` |
2026-01-28 16:28:57 +08:00
|`FluxPipeline` | FLUX.1-dev | `black-forest-labs/FLUX.1-dev` |
2026-02-26 18:34:28 +08:00
|`OmniGen2Pipeline` | OmniGen2 | `OmniGen2/OmniGen2` |
2026-01-07 02:01:06 -07:00
|`StableAudioPipeline` | Stable-Audio-Open | `stabilityai/stable-audio-open-1.0` |
2026-01-22 16:57:37 +08:00
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-CustomVoice | `Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice` |
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-VoiceDesign | `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign` |
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-Base | `Qwen/Qwen3-TTS-12Hz-0.6B-Base` |
2026-02-27 10:29:14 +08:00
|`GlmImageForConditionalGeneration` | GLM-Image | `zai-org/GLM-Image` |
2026-02-25 08:09:11 -08:00
|`NextStep11Pipeline` | NextStep-1.1 | `stepfun-ai/NextStep-1.1` |
2026-02-27 11:19:49 +08:00
|`MiMoAudioForConditionalGeneration` | MiMo-Audio-7B-Instruct | `XiaomiMiMo/MiMo-Audio-7B-Instruct` |
2026-03-11 14:44:18 +08:00
|`Flux2Pipeline` | FLUX.2-dev | `black-forest-labs/FLUX.2-dev` |
2026-03-12 16:20:52 -04:00
|`FishSpeechSlowARForConditionalGeneration` | Fish Speech S2 Pro | `fishaudio/s2-pro` |
2026-03-13 21:53:06 +08:00
|`DreamIDOmniPipeline` | DreamID-Omni | `XuGuo699/DreamID-Omni` |
2025-11-28 11:03:52 +08:00
2025-12-04 15:21:11 +08:00
## List of Supported Models for NPU
2025-11-28 11:03:52 +08:00
<style>
th {
white-space: nowrap;
min-width: 0 !important;
}
</style>
| Architecture | Models | Example HF Models |
|--------------|--------|-------------------|
2026-02-04 15:10:50 +08:00
| `Qwen3OmniMoeForConditionalGeneration` | Qwen3-Omni | `Qwen/Qwen3-Omni-30B-A3B-Instruct` |
2025-11-28 11:03:52 +08:00
| `Qwen2_5OmniForConditionalGeneration` | Qwen2.5-Omni | `Qwen/Qwen2.5-Omni-7B` , `Qwen/Qwen2.5-Omni-3B` |
2026-03-12 20:49:17 +08:00
| `HunyuanImage3ForCausalMM` | HunyuanImage3.0 (DiT-only) | `tencent/HunyuanImage-3.0` , `tencent/HunyuanImage-3.0-Instruct` |
2025-12-01 08:36:04 +08:00
| `QwenImagePipeline` | Qwen-Image | `Qwen/Qwen-Image` |
2025-12-31 15:03:24 +08:00
| `QwenImagePipeline` | Qwen-Image-2512 | `Qwen/Qwen-Image-2512` |
2025-12-27 10:46:10 +08:00
| `QwenImageEditPipeline` | Qwen-Image-Edit | `Qwen/Qwen-Image-Edit` |
| `QwenImageEditPlusPipeline` | Qwen-Image-Edit-2509 | `Qwen/Qwen-Image-Edit-2509` |
| `QwenImageLayeredPipeline` | Qwen-Image-Layered | `Qwen/Qwen-Image-Layered` |
| `QwenImageEditPlusPipeline` | Qwen-Image-Edit-2511 | `Qwen/Qwen-Image-Edit-2511` |
2025-12-26 21:52:25 +08:00
|`ZImagePipeline` | Z-Image | `Tongyi-MAI/Z-Image-Turbo` |
2026-02-28 12:46:13 +08:00
| `WanPipeline` | Wan2.2-T2V, Wan2.2-TI2V | `Wan-AI/Wan2.2-T2V-A14B-Diffusers` , `Wan-AI/Wan2.2-TI2V-5B-Diffusers` |
| `WanImageToVideoPipeline` | Wan2.2-I2V | `Wan-AI/Wan2.2-I2V-A14B-Diffusers` |
2026-02-04 15:10:50 +08:00
|`LongcatImagePipeline` | LongCat-Image | `meituan-longcat/LongCat-Image` |
2026-02-28 12:46:13 +08:00
|`LongCatImageEditPipeline` | LongCat-Image-Edit | `meituan-longcat/LongCat-Image-Edit` |
2026-02-04 15:10:50 +08:00
|`Flux2KleinPipeline` | FLUX.2-klein | `black-forest-labs/FLUX.2-klein-4B` , `black-forest-labs/FLUX.2-klein-9B` |
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-CustomVoice | `Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice` |
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-VoiceDesign | `Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign` |
|`Qwen3TTSForConditionalGeneration` | Qwen3-TTS-12Hz-1.7B-Base | `Qwen/Qwen3-TTS-12Hz-0.6B-Base` |