Hongsheng LiuandClaude Opus 4.7
471ddfe025
Signed-off-by: hsliu <liuhongsheng4@huawei.com> Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
83 lines
1.2 KiB
Markdown
83 lines
1.2 KiB
Markdown
# Recipe Title
|
|
|
|
> Example: Qwen3-Omni for speech chat
|
|
|
|
## Summary
|
|
|
|
- Vendor:
|
|
- Model:
|
|
- Task:
|
|
- Mode:
|
|
- Maintainer:
|
|
|
|
## When to use this recipe
|
|
|
|
Briefly describe the concrete scenario this recipe covers.
|
|
|
|
## References
|
|
|
|
- Upstream or canonical docs:
|
|
- Related example under `examples/`:
|
|
- Related issue or discussion:
|
|
|
|
## Hardware Support
|
|
|
|
Add one section per platform, such as `GPU`, `ROCm`, or `NPU`. Under each
|
|
platform section, document one or more tested hardware configurations.
|
|
|
|
## GPU
|
|
|
|
### 1x A100 80GB
|
|
|
|
#### Environment
|
|
|
|
- OS:
|
|
- Python:
|
|
- Driver / runtime:
|
|
- vLLM version:
|
|
- vLLM-Omni version or commit:
|
|
|
|
#### Command
|
|
|
|
```bash
|
|
# Add the exact command(s) here
|
|
```
|
|
|
|
#### Verification
|
|
|
|
```bash
|
|
# Add a quick validation command or expected output here
|
|
```
|
|
|
|
#### Notes
|
|
|
|
- Memory usage:
|
|
- Key flags:
|
|
- Known limitations:
|
|
|
|
### 2x L40S
|
|
|
|
Repeat the same structure for other hardware setups as needed.
|
|
|
|
## ROCm
|
|
|
|
### Example hardware configuration
|
|
|
|
Repeat the same nested structure for ROCm setups as needed:
|
|
|
|
- `#### Environment`
|
|
- `#### Command`
|
|
- `#### Verification`
|
|
- `#### Notes`
|
|
|
|
## NPU
|
|
|
|
### Example hardware configuration
|
|
|
|
Repeat the same nested structure for NPU setups as needed:
|
|
|
|
- `#### Environment`
|
|
- `#### Command`
|
|
- `#### Verification`
|
|
- `#### Notes`
|