vllm-omni/recipes/TEMPLATE.md

Recipe Title

Example: Qwen3-Omni for speech chat on 1x A100 80GB

Summary

• Vendor:
• Model:
• Task:
• Mode:
• Maintainer:

When to use this recipe

Briefly describe the concrete scenario this recipe covers.

References

• Upstream or canonical docs:
• Related example under examples/:
• Related issue or discussion:

Hardware Support

Add one section per platform, such as GPU, ROCm, or NPU. Under each platform section, document one or more tested hardware configurations.

GPU

1x A100 80GB

Environment

• OS:
• Python:
• Driver / runtime:
• vLLM version:
• vLLM-Omni version or commit:

Command

# Add the exact command(s) here

Verification

# Add a quick validation command or expected output here

Notes

• Memory usage:
• Key flags:
• Known limitations:

2x L40S

Repeat the same structure for other hardware setups as needed.

ROCm

Repeat the same structure for ROCm setups as needed.

NPU

Repeat the same structure for NPU setups as needed.