706bad253d
Signed-off-by: Maciej Bala <mbala@nvidia.com> Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com> Signed-off-by: lishunyang12 <lishunyang12@163.com> Co-authored-by: Maciej Bala <mbala@nvidia.com> Co-authored-by: lishunyang12 <lishunyang12@163.com> Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Community Recipes
This directory contains community-maintained recipes for answering a practical user question:
How do I run model X on hardware Y for task Z?
Add recipes for this repository under this in-repo recipes/ directory. To
keep naming and layout consistent, organize recipes by model vendor in a way
that is aligned with
vllm-project/recipes, but treat
that external repository as a reference for structure rather than the place to
add files for this repo. Use one Markdown file per model family by default.
Example layout:
recipes/
Qwen/
Qwen3-Omni.md
Qwen3-TTS.md
Tencent/
Covo-Audio-Chat.md
Available Recipes
| Recipe | Task | Hardware |
|---|---|---|
audiox/AudioX.md |
Offline + online unified text/video→audio diffusion | 1x L4 24GB |
Baidu/ERNIE-Image.md |
Text-to-image online serving (ERNIE-Image 8B) | 1x or 2x RTX 4090 24GB |
ByteDance/Lance.md |
Unified AR+diffusion: text/img/video gen + understanding (Lance 3B) | 1x B300 / A100 80GB |
fishaudio/Fish-Speech-S2-Pro.md |
Online serving for TTS | 1x A800 80GB |
Helios/Helios.md |
Text-to-video, image-to-video, and video-to-video generation | 1x NVIDIA H20 |
inclusionAI/Ming-flash-omni-2.0.md |
Online serving for multimodal chat + standalone TTS | 4x H100 / 1x H100 80GB |
LTX/LTX-2.md |
Text-to-video and image-to-video serving | 1x H200 141GB |
LTX/LTX-2.3.md |
Text-to-video with audio generation (22B) | 1x GPU (96GB VRAM) |
mistralai/Voxtral-TTS.md |
Online serving for TTS | 1x RTX 4090 24GB |
cosmos3/Cosmos3-Nano.md |
Text-to-image, text-to-video, image-to-video generation, text to video with sound, action policy | 1x H200 141GB / B300 |
cosmos3/Cosmos3-Super.md |
64B T2I / T2V / I2V generation (+ optional audio) / Action policy | 8x H200/H100/A100 / 2x H200 / B300 |
OpenBMB/MiniCPM-o-4_5.md |
Online serving for omni multimodal chat (text / image / audio / video → text + 24 kHz speech) | 2x A100/H100 80GB / 3x mid-tier GPU / 8x RTX 4090 24GB |
OpenBMB/VoxCPM2.md |
Online + offline TTS with native AR pipeline (48 kHz, 30+ languages) | 1x RTX 4090 24GB |
Qwen/Qwen-Image.md |
Text-to-image serving with step-wise continuous batching replay and ModelOpt mixed FP8/NVFP4 | 1x A100 80GB / 2x B200 |
Qwen/Qwen-Image.md |
Text-to-image serving with step-wise continuous batching replay | 1x A100 80GB |
Qwen/Qwen-Image-Edit.md |
Text-guided single-image editing | 1x or 2x H200 141GB |
Qwen/Qwen3-Omni.md |
Online serving for multimodal chat | 1x A100 80GB |
Qwen/Qwen3-TTS.md |
Text-to-speech serving (CustomVoice / VoiceDesign / Base) | 1x H100/A100 80GB |
SenseNova/SenseNova-U1.md |
Unified image generation and understanding | 1x H200 (144GB) |
Tencent/Covo-Audio-Chat.md |
Online serving for audio chat | 1x A100 80GB |
Tencent/HunyuanImage-3.0-Instruct.md |
DiT-only text-to-image serving and benchmark, including ModelOpt mixed FP8/NVFP4 | 4x H100/H800 80GB / 2x B200 |
Wan-AI/Wan2.2-I2V.md |
Image-to-video serving (Wan2.2 14B) | 8x Ascend NPU (A2/A3) |
Wan-AI/Wan2.2-S2V.md |
Speech-to-video serving (Wan2.2 14B) | 2x A100/H100 80GB |
zai-org/GLM-TTS.md |
Online serving for Chinese/English zero-shot voice-cloned TTS | 1x A40 48GB |
GLM/GLM-Image.md |
Online serving for image generation | 1x A800 80GB / 2x A800 80GB |
Within a single recipe file, include different hardware support sections such
as GPU, ROCm, and NPU, and add concrete tested configurations like
1x A100 80GB or 2x L40S inside those sections when applicable.
See TEMPLATE.md for the recommended format.