Hongsheng LiuandCopilot
5a68c217e2
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com> Signed-off-by: hsliu <liuhongsheng4@huawei.com> Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
36 lines
1.1 KiB
Markdown
36 lines
1.1 KiB
Markdown
# Community Recipes
|
|
|
|
This directory contains community-maintained recipes for answering a
|
|
practical user question:
|
|
|
|
> How do I run model X on hardware Y for task Z?
|
|
|
|
Add recipes for this repository under this in-repo `recipes/` directory. To
|
|
keep naming and layout consistent, organize recipes by model vendor in a way
|
|
that is aligned with
|
|
[`vllm-project/recipes`](https://github.com/vllm-project/recipes), but treat
|
|
that external repository as a reference for structure rather than the place to
|
|
add files for this repo. Use one Markdown file per model family by default.
|
|
|
|
Example layout:
|
|
|
|
```text
|
|
recipes/
|
|
Qwen/
|
|
Qwen3-Omni.md
|
|
Qwen3-TTS.md
|
|
Tencent-Hunyuan/
|
|
HunyuanVideo.md
|
|
```
|
|
|
|
## Available Recipes
|
|
|
|
- [`Qwen/Qwen3-Omni.md`](./Qwen/Qwen3-Omni.md): online serving recipe for
|
|
multimodal chat on `1x A100 80GB`
|
|
|
|
Within a single recipe file, include different hardware support sections such
|
|
as `GPU`, `ROCm`, and `NPU`, and add concrete tested configurations like
|
|
`1x A100 80GB` or `2x L40S` inside those sections when applicable.
|
|
|
|
See [TEMPLATE.md](./TEMPLATE.md) for the recommended format.
|