Hongsheng LiuandCopilot
5a68c217e2
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com> Signed-off-by: hsliu <liuhongsheng4@huawei.com> Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1.1 KiB
Community Recipes
This directory contains community-maintained recipes for answering a practical user question:
How do I run model X on hardware Y for task Z?
Add recipes for this repository under this in-repo recipes/ directory. To
keep naming and layout consistent, organize recipes by model vendor in a way
that is aligned with
vllm-project/recipes, but treat
that external repository as a reference for structure rather than the place to
add files for this repo. Use one Markdown file per model family by default.
Example layout:
recipes/
Qwen/
Qwen3-Omni.md
Qwen3-TTS.md
Tencent-Hunyuan/
HunyuanVideo.md
Available Recipes
Qwen/Qwen3-Omni.md: online serving recipe for multimodal chat on1x A100 80GB
Within a single recipe file, include different hardware support sections such
as GPU, ROCm, and NPU, and add concrete tested configurations like
1x A100 80GB or 2x L40S inside those sections when applicable.
See TEMPLATE.md for the recommended format.