vllm-omni/docs/examples

Examples

vLLM-Omni's examples are split into two categories:

• If you are using vLLM-Omni from within Python code, see the Offline Inference section.
• If you are using vLLM-Omni from an HTTP application or client, start with the API Server guide to choose an endpoint, then use the Online Serving section for model-specific examples.