vllm-omni/recipes

Community Recipes

This directory contains community-maintained recipes for answering a practical user question:

How do I run model X on hardware Y for task Z?

Add recipes for this repository under this in-repo recipes/ directory. To keep naming and layout consistent, organize recipes by model vendor in a way that is aligned with vllm-project/recipes, but treat that external repository as a reference for structure rather than the place to add files for this repo. Use one Markdown file per model family by default.

Example layout:

recipes/
  Qwen/
    Qwen3-Omni.md
    Qwen3-TTS.md
  Tencent/
    Covo-Audio-Chat.md

Available Recipes

Recipe	Task	Hardware
audiox/AudioX.md	Offline + online unified text/video→audio diffusion	1x L4 24GB
Baidu/ERNIE-Image.md	Text-to-image online serving (ERNIE-Image 8B)	1x or 2x RTX 4090 24GB
fishaudio/Fish-Speech-S2-Pro.md	Online serving for TTS	1x A800 80GB
inclusionAI/Ming-flash-omni-2.0.md	Online serving for multimodal chat + standalone TTS	4x H100 / 1x H100 80GB
LTX/LTX-2.md	Text-to-video and image-to-video serving	1x H200 141GB
LTX/LTX-2.3.md	Text-to-video with audio generation (22B)	1x GPU (96GB VRAM)
Qwen/Qwen-Image.md	Text-to-image serving with step-wise continuous batching replay	1x A100 80GB
Qwen/Qwen3-Omni.md	Online serving for multimodal chat	1x A100 80GB
Qwen/Qwen3-TTS.md	Text-to-speech serving (CustomVoice / VoiceDesign / Base)	1x H100/A100 80GB
SenseNova/SenseNova-U1.md	Unified image generation and understanding	1x H200 (144GB)
Tencent/Covo-Audio-Chat.md	Online serving for audio chat	1x A100 80GB
Tencent/HunyuanImage-3.0-Instruct.md	DiT-only text-to-image serving and benchmark	4x H100/H800 80GB
Wan-AI/Wan2.2-I2V.md	Image-to-video serving (Wan2.2 14B)	8x Ascend NPU (A2/A3)
Wan-AI/Wan2.2-S2V.md	Speech-to-video serving (Wan2.2 14B)	2x A100/H100 80GB

Within a single recipe file, include different hardware support sections such as GPU, ROCm, and NPU, and add concrete tested configurations like 1x A100 80GB or 2x L40S inside those sections when applicable.

See TEMPLATE.md for the recommended format.