vllm-omni/docs/models/supported_models.md

Supported Models

vLLM-Omni supports unified multimodal comprehension and generation models across various tasks.

Model Implementation

If vLLM-Omni natively supports a model, its implementation can be found in gh-file:vllm-omni/model_executor/models.

List of Supported Models for Nvidia GPU

<style> th { white-space: nowrap; min-width: 0 !important; } </style>

Architecture	Models	Example HF Models
Qwen2_5OmniForConditionalGeneration	Qwen2.5-Omni	Qwen/Qwen2.5-Omni-7B, Qwen/Qwen2.5-Omni-3B

List of Supported Models for Ascend NPU

<style> th { white-space: nowrap; min-width: 0 !important; } </style>

Architecture	Models	Example HF Models
Qwen2_5OmniForConditionalGeneration	Qwen2.5-Omni	Qwen/Qwen2.5-Omni-7B, Qwen/Qwen2.5-Omni-3B