Hongsheng Liuandhsliu_ustc
44c8d1c449
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
9 lines
371 B
Markdown
9 lines
371 B
Markdown
# Examples
|
|
|
|
vLLM-Omni's examples are split into two categories:
|
|
|
|
- If you are using vLLM-Omni from within Python code, see the *Offline Inference* section.
|
|
- If you are using vLLM-Omni from an HTTP application or client, start with
|
|
the [API Server guide](../serving/README.md) to choose an endpoint, then use
|
|
the *Online Serving* section for model-specific examples.
|