vllm-omni/docs/user_guide/examples/index.md

Examples

vLLM-omni's examples are split into two categories:

• If you are using vLLM-omni from within Python code, see the Offline Inference section.
• If you are using vLLM-omni from an HTTP application or client, see the Online Serving section.

For detailed example documentation, check the examples directory in the repository.