vllm-omni/recipes/TEMPLATE.md

Recipe Title

Example: Qwen3-Omni for speech chat

Summary

• Vendor:
• Model:
• Task:
• Mode:
• Maintainer:

When to use this recipe

Briefly describe the concrete scenario this recipe covers.

References

• Upstream or canonical docs:
• Related example under examples/:
• Related issue or discussion:

Hardware Support

Add one section per platform, such as GPU, ROCm, or NPU. Under each platform section, document one or more tested hardware configurations.

GPU

1x A100 80GB

Environment

• OS:
• Python:
• Driver / runtime:
• vLLM version:
• vLLM-Omni version or commit:

Command

Serve commands use vllm serve <model> --omni. The --omni flag is what selects the Omni pipeline, so it is required and cannot be dropped.

# Add the exact command(s) here

Verification

# Add a quick validation command or expected output here

Notes

• Memory usage:
• Key flags:
• Known limitations:

2x L40S

Repeat the same structure for other hardware setups as needed.

ROCm

Example hardware configuration

Repeat the same nested structure for ROCm setups as needed:

• #### Environment
• #### Command
• #### Verification
• #### Notes

NPU

Example hardware configuration

Repeat the same nested structure for NPU setups as needed:

• #### Environment
• #### Command
• #### Verification
• #### Notes