+1
f92d84fcf9
f92d84fcf9
Signed-off-by: tzhouam <tzhouam@connect.ust.hk> Signed-off-by: ZhengWG <zwg0606@gmail.com> Signed-off-by: david6666666 <530634352@qq.com> Signed-off-by: Yueqian Lin <linyueqian@outlook.com> Signed-off-by: nainiu258 <cperfect02@163.com> Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com> Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn> Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk> Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com> Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com> Co-authored-by: Zheng Wengang <zwg0606@gmail.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com> Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com> Co-authored-by: Yueqian Lin <linyueqian@outlook.com> Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com> Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com> Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Community Recipes
This directory contains community-maintained recipes for answering a practical user question:
How do I run model X on hardware Y for task Z?
Add recipes for this repository under this in-repo recipes/ directory. To
keep naming and layout consistent, organize recipes by model vendor in a way
that is aligned with
vllm-project/recipes, but treat
that external repository as a reference for structure rather than the place to
add files for this repo. Use one Markdown file per model family by default.
Example layout:
recipes/
Qwen/
Qwen3-Omni.md
Qwen3-TTS.md
Tencent/
Covo-Audio-Chat.md
Available Recipes
| Recipe | Task | Hardware |
|---|---|---|
audiox/AudioX.md |
Offline + online unified text/video→audio diffusion | 1x L4 24GB |
Baidu/ERNIE-Image.md |
Text-to-image online serving (ERNIE-Image 8B) | 1x or 2x RTX 4090 24GB |
fishaudio/Fish-Speech-S2-Pro.md |
Online serving for TTS | 1x A800 80GB |
Helios/Helios.md |
Text-to-video, image-to-video, and video-to-video generation | 1x NVIDIA H20 |
inclusionAI/Ming-flash-omni-2.0.md |
Online serving for multimodal chat + standalone TTS | 4x H100 / 1x H100 80GB |
LTX/LTX-2.md |
Text-to-video and image-to-video serving | 1x H200 141GB |
LTX/LTX-2.3.md |
Text-to-video with audio generation (22B) | 1x GPU (96GB VRAM) |
mistralai/Voxtral-TTS.md |
Online serving for TTS | 1x RTX 4090 24GB |
Qwen/Qwen-Image.md |
Text-to-image serving with step-wise continuous batching replay and ModelOpt mixed FP8/NVFP4 | 1x A100 80GB / 2x B200 |
Qwen/Qwen-Image.md |
Text-to-image serving with step-wise continuous batching replay | 1x A100 80GB |
Qwen/Qwen-Image-Edit.md |
Text-guided single-image editing | 1x or 2x H200 141GB |
Qwen/Qwen3-Omni.md |
Online serving for multimodal chat | 1x A100 80GB |
Qwen/Qwen3-TTS.md |
Text-to-speech serving (CustomVoice / VoiceDesign / Base) | 1x H100/A100 80GB |
SenseNova/SenseNova-U1.md |
Unified image generation and understanding | 1x H200 (144GB) |
Tencent/Covo-Audio-Chat.md |
Online serving for audio chat | 1x A100 80GB |
Tencent/HunyuanImage-3.0-Instruct.md |
DiT-only text-to-image serving and benchmark, including ModelOpt mixed FP8/NVFP4 | 4x H100/H800 80GB / 2x B200 |
Wan-AI/Wan2.2-I2V.md |
Image-to-video serving (Wan2.2 14B) | 8x Ascend NPU (A2/A3) |
Wan-AI/Wan2.2-S2V.md |
Speech-to-video serving (Wan2.2 14B) | 2x A100/H100 80GB |
zai-org/GLM-TTS.md |
Online serving for Chinese/English zero-shot voice-cloned TTS | 1x A40 48GB |
GLM/GLM-Image.md |
Online serving for image generation | 1x A800 80GB / 2x A800 80GB |
Within a single recipe file, include different hardware support sections such
as GPU, ROCm, and NPU, and add concrete tested configurations like
1x A100 80GB or 2x L40S inside those sections when applicable.
See TEMPLATE.md for the recommended format.