Hongsheng Liuandhsliu_ustc
44c8d1c449
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
371 B
371 B
Examples
vLLM-Omni's examples are split into two categories:
- If you are using vLLM-Omni from within Python code, see the Offline Inference section.
- If you are using vLLM-Omni from an HTTP application or client, start with the API Server guide to choose an endpoint, then use the Online Serving section for model-specific examples.