vllm-omni/docs/models/supported_models.md

Supported Models

vLLM-Omni supports unified multimodal comprehension and generation models across various tasks.

Model Implementation

If vLLM-Omni natively supports a model, its implementation can be found in gh-file:vllm_omni/model_executor/models and gh-file:vllm_omni/diffusion/models.

For deployment recipes (TTS and multimodal), see recipes.vllm.ai and the in-repo recipes/ directory.

List of Supported Models

<style> th { white-space: nowrap; min-width: 0 !important; } </style>

Architecture	Models	Example HF Models	NVIDIA GPU	AMD GPU	Ascend NPU	Intel GPU	Recipe
Qwen3OmniMoeForConditionalGeneration	Qwen3-Omni	Qwen/Qwen3-Omni-30B-A3B-Instruct	✅︎				Repository
Qwen2_5OmniForConditionalGeneration	Qwen2.5-Omni	Qwen/Qwen2.5-Omni-7B, Qwen/Qwen2.5-Omni-3B	✅︎	✅︎	✅︎	✅︎	—
MingFlashOmniForConditionalGeneration + MingImagePipeline	Ming-flash-omni-2.0 (omni-speech + imagegen1)	Jonathan1909/Ming-flash-omni-2.0	✅︎				—
BagelForConditionalGeneration	BAGEL (DiT-only)	ByteDance-Seed/BAGEL-7B-MoT	✅︎	✅︎		✅︎	—
InternVLAA1Pipeline	InternVLA-A1	InternRobotics/InternVLA-A1-3B	✅︎	✅︎			—
Gr00tN1d7Pipeline	GR00T N1.7	nvidia/GR00T-N1.7-3B	✅︎				—
HunyuanImage3ForCausalMM	HunyuanImage3.0 (DiT-only)	tencent/HunyuanImage-3.0, tencent/HunyuanImage-3.0-Instruct	✅︎	✅︎	✅︎	✅︎	—
QwenImagePipeline	Qwen-Image	Qwen/Qwen-Image	✅︎				Published
QwenImagePipeline	Qwen-Image-2512	Qwen/Qwen-Image-2512	✅︎				Repository
QwenImageEditPipeline	Qwen-Image-Edit	Qwen/Qwen-Image-Edit	✅︎	✅︎	✅︎	✅︎	—
QwenImageEditPlusPipeline	Qwen-Image-Edit-2509	Qwen/Qwen-Image-Edit-2509	✅︎	✅︎	✅︎	✅︎	—
QwenImageLayeredPipeline	Qwen-Image-Layered	Qwen/Qwen-Image-Layered	✅︎	✅︎	✅︎	✅︎	—
QwenImageEditPlusPipeline	Qwen-Image-Edit-2511	Qwen/Qwen-Image-Edit-2511	✅︎	✅︎	✅︎	✅︎	—
GlmImagePipeline	GLM-Image	zai-org/GLM-Image	✅︎	✅︎			—
ZImagePipeline	Z-Image	Tongyi-MAI/Z-Image-Turbo	✅︎	✅︎	✅︎	✅︎	—
Krea2Pipeline	Krea 2 (Raw + Turbo)	krea/Krea-2-Raw, krea/Krea-2-Turbo	✅︎				—
WanPipeline	Wan2.1-T2V, Wan2.2-T2V, Wan2.2-TI2V	Wan-AI/Wan2.1-T2V-1.3B-Diffusers, Wan-AI/Wan2.1-T2V-14B-Diffusers, Wan-AI/Wan2.2-T2V-A14B-Diffusers, Wan-AI/Wan2.2-TI2V-5B-Diffusers	✅︎	✅︎	✅︎	✅︎	—
WanImageToVideoPipeline	Wan2.2-I2V	Wan-AI/Wan2.2-I2V-A14B-Diffusers	✅︎	✅︎	✅︎	✅︎	—
Cosmos3OmniDiffusersPipeline	Cosmos3 T2I, T2V, I2V, V2V, T2V with sound, action policy	nvidia/Cosmos3-Nano, nvidia/Cosmos3-Super	✅︎	✅︎	✅︎	✅︎	—
Wan22S2VPipeline	Wan2.2-S2V	Wan-AI/Wan2.2-S2V-14B	✅︎	✅︎	✅︎	✅︎	—
Wan22VACEPipeline	Wan2.1-VACE	Wan-AI/Wan2.1-VACE-1.3B-diffusers, Wan-AI/Wan2.1-VACE-14B-diffusers	✅︎	✅︎	✅︎	✅︎	—
Wan22VACEPipeline	Wan2.2-VACE	Pyros13/Wan2.2-VACE-Fun-A14B-Diffusers	✅︎				—
LTX2Pipeline	LTX-2 / LTX-2.3 one-stage T2V and I2V	Lightricks/LTX-2, diffusers/LTX-2.3-Diffusers	✅︎	✅︎			—
LTX2DistilledPipeline	LTX-2 distilled two-stage T2V and I2V	rootonchair/LTX-2-19b-distilled	✅︎	✅︎			—
LingBotVideoPipeline	LingBot-Video dense and MoE T2I, T2V, TI2V	robbyant/lingbot-video-dense-1.3b, robbyant/lingbot-video-moe-30b-a3b	✅︎				—
MiniMaxH3Pipeline	MiniMax H3 T2VA, first/last-keyframe FL2VA, and mixed-reference Ref2VA	MiniMaxAI/MiniMax-H3	✅︎	✅︎			Published
DreamZeroPipeline	DreamZero-DROID	GEAR-Dreams/DreamZero-DROID	✅︎	✅︎	✅︎	✅︎	—
HeliosPipeline, HeliosPyramidPipeline	Helios	BestWishYsh/Helios-Base, BestWishYsh/Helios-Mid, BestWishYsh/Helios-Distilled	✅︎	✅︎	✅︎		—
MagiHumanPipeline	MagiHuman	SII-GAIR/daVinci-MagiHuman-Base-1080p	✅︎	✅︎			—
OvisImagePipeline	Ovis-Image	OvisAI/Ovis-Image	✅︎	✅︎		✅︎	—
LongcatImagePipeline	LongCat-Image	meituan-longcat/LongCat-Image	✅︎	✅︎	✅︎	✅︎	—
LongCatImageEditPipeline	LongCat-Image-Edit	meituan-longcat/LongCat-Image-Edit	✅︎	✅︎	✅︎	✅︎	—
BooguImagePipeline	Boogu-Image	Boogu/Boogu-Image-0.1-Base, Boogu/Boogu-Image-0.1-Edit	✅︎				—
StableDiffusionXLPipeline	Stable-Diffusion-XL	stabilityai/stable-diffusion-xl-base-1.0	✅︎	✅︎	✅︎	✅︎	—
StableDiffusion3Pipeline	Stable-Diffusion-3	stabilityai/stable-diffusion-3.5-medium	✅︎	✅︎		✅︎	—
CosyVoice3Model	CosyVoice3	FunAudioLLM/Fun-CosyVoice3-0.5B-2512	✅︎	✅︎		✅︎	—
OmniVoiceModel	OmniVoice	k2-fsa/OmniVoice	✅︎				—
VoxCPM2TalkerForConditionalGeneration	VoxCPM2	openbmb/VoxCPM2	✅︎				—
MammothModa2ForConditionalGeneration	MammothModa2-Preview	bytedance-research/MammothModa2-Preview	✅︎	✅︎			—
MammothModa2ForConditionalGeneration	MammothModa2-Dev (AR-only image understanding)	bytedance-research/MammothModa2-Dev	✅︎				—
Flux2KleinPipeline	FLUX.2-klein	black-forest-labs/FLUX.2-klein-4B, black-forest-labs/FLUX.2-klein-9B	✅︎	✅︎	✅︎	✅︎	—
FluxKontextPipeline	FLUX.1-Kontext-dev	black-forest-labs/FLUX.1-Kontext-dev	✅︎	✅︎			—
FluxPipeline	FLUX.1-dev	black-forest-labs/FLUX.1-dev	✅︎	✅︎		✅︎	—
FluxPipeline	FLUX.1-schnell	black-forest-labs/FLUX.1-schnell	✅︎	✅︎		✅︎	—
OmniGen2Pipeline	OmniGen2	OmniGen2/OmniGen2	✅︎	✅︎		✅︎	—
StableAudioPipeline	Stable-Audio-Open	stabilityai/stable-audio-open-1.0	✅︎	✅︎		✅︎	—
SoulXSingerPipeline	SoulX-Singer (SVS)	Soul-AILab/SoulX-Singer	✅︎				—
SoulXSingerSVCPipeline	SoulX-Singer-SVC	Soul-AILab/SoulX-Singer (model-svc.pt)	✅︎				—
AudioXPipeline	AudioX	zhangj1an/AudioX	✅︎	✅︎			—
Qwen3TTSForConditionalGeneration	Qwen3-TTS-12Hz-1.7B-CustomVoice	Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice	✅︎				Published
Qwen3TTSForConditionalGeneration	Qwen3-TTS-12Hz-1.7B-VoiceDesign	Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign	✅︎	✅︎	✅︎	✅︎	—
Qwen3TTSForConditionalGeneration	Qwen3-TTS-12Hz-1.7B-Base	Qwen/Qwen3-TTS-12Hz-1.7B-Base	✅︎	✅︎	✅︎	✅︎	—
MingTTSForConditionalGeneration	Ming-omni-tts dense 0.5B	inclusionAI/Ming-omni-tts-0.5B	✅︎				—
GLMTTSForConditionalGeneration	GLM-TTS	zai-org/GLM-TTS	✅︎				—
MossTTSNanoForCausalLM	MOSS-TTS-Nano	OpenMOSS-Team/MOSS-TTS-Nano	✅︎				—
MossTTSDelayModel	MOSS-TTS, MOSS-TTSD, MOSS-SoundEffect, MOSS-VoiceGenerator	OpenMOSS-Team/MOSS-VoiceGenerator	✅︎				—
MossTTSRealtime	MOSS-TTS-Realtime	OpenMOSS-Team/MOSS-TTS-Realtime	✅︎				—
HiggsAudioV2ForConditionalGeneration	Higgs-Audio v2	bosonai/higgs-audio-v2-generation-3B-base	✅︎				—
HiggsMultimodalQwen3ForConditionalGeneration	Higgs-Audio v3 (TTS)	bosonai/higgs-audio-v3-tts-4b	✅︎				Published
IndexTTS2TalkerForConditionalGeneration	IndexTTS-2	IndexTeam/IndexTTS-2	✅︎				—
NextStep11Pipeline	NextStep-1.1	stepfun-ai/NextStep-1.1	✅︎	✅︎		✅︎	—
MiMoAudioModel	MiMo-Audio-7B-Instruct	XiaomiMiMo/MiMo-Audio-7B-Instruct	✅︎	✅︎			—
MiMoV2ASRForCausalLM	MiMo-V2.5-ASR	XiaomiMiMo/MiMo-V2.5-ASR	✅︎	✅︎			—
Flux2Pipeline	FLUX.2-dev	black-forest-labs/FLUX.2-dev	✅︎	✅︎			—
FishSpeechSlowARForConditionalGeneration	Fish Speech S2 Pro	fishaudio/s2-pro	✅︎	✅︎		✅︎	—
DreamIDOmniPipeline	DreamID-Omni	XuGuo699/DreamID-Omni	✅︎	✅︎			—
SenseNovaU1Pipeline	SenseNova-U1 (DiT-only)	SenseNova/SenseNova-U1-8B-MoT	✅︎				—
LancePipeline	Lance	bytedance-research/Lance	✅︎				—
HunyuanVideo15Pipeline	HunyuanVideo-1.5-T2V	hunyuanvideo-community/HunyuanVideo-1.5-Diffusers-480p_t2v, hunyuanvideo-community/HunyuanVideo-1.5-Diffusers-720p_t2v	✅︎	✅︎			—
HunyuanVideo15ImageToVideoPipeline	HunyuanVideo-1.5-I2V	hunyuanvideo-community/HunyuanVideo-1.5-Diffusers-480p_i2v, hunyuanvideo-community/HunyuanVideo-1.5-Diffusers-720p_i2v	✅︎	✅︎			—
VoxtralTTSForConditionalGeneration	Voxtral TTS	mistralai/Voxtral-4B-TTS-2603	✅︎	✅︎			—
CovoAudioForConditionalGeneration	Covo-Audio-Chat	tencent/Covo-Audio-Chat	✅︎				—
DyninOmniForConditionalGeneration	Dynin-Omni	snu-aidas/Dynin-Omni	✅︎				—
MiniCPMO45OmniForConditionalGeneration	MiniCPM-o 4.5	openbmb/MiniCPM-o-4_5	✅︎		✅︎		—
ErnieImagePipeline	ERNIE-Image	baidu/ERNIE-Image, baidu/ERNIE-Image-Turbo	✅︎	✅︎	✅︎	✅︎	—
HiDreamImagePipeline	HiDream-I1-Full	HiDream-ai/HiDream-I1-Full	✅︎	✅︎			—

The Recipe column links the exact checkpoint/task entry from recipe_coverage.yaml. Published is preferred when a corresponding recipes.vllm.ai page exists; otherwise the link points to the repository recipe. — means that the exact checkpoint/task mapping has not been audited yet.

For rows with an audited recipe link, the hardware checkmarks reflect hardware explicitly documented in that recipe. Other rows retain the implementation support metadata until their recipe coverage is audited.

✅︎ indicates the model is supported on that backend. Empty cells mean not listed as supported on that backend.

Recipe and Example Coverage

The table above describes implementation and backend support. It does not imply that a model has a validated deployment recipe.

Recipe and example coverage is tracked per exact Hugging Face checkpoint and task in the machine-readable recipe_coverage.yaml. The registry is populated as coverage is audited and is the source of truth for mapping exact checkpoints and tasks to links. Recipe files under recipes/ remain the source of truth for commands and validation details. It uses the following link precedence:

1. published: link to the published recipes.vllm.ai page.
2. repository: link to the in-repository recipe until a published page exists.
3. no_validated_recipe_yet: show No validated recipe yet only when that result has been explicitly audited.
4. A checkpoint/task without an entry: coverage has not been audited yet.

Split entries whenever checkpoints, tasks, examples, or validation evidence differ. A single Supported Models row may therefore map to multiple registry entries.

^H3 MiniMax H3 AMD GPU support is validated on gfx942 (MI300X) and gfx950 (MI350) in BF16, using the AITER FLASH_ATTN diffusion attention backend. Other AMD SKUs (e.g. MI325X) are not listed until their own validation evidence is added. See the MiniMax H3 recipe for per-architecture serving commands.