anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Doc] Refine the document. (#403)

Browse Source 
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
This commit is contained in:
Alicia authored and GitHub committed 2025-12-22 21:29:40 +08:00
1 parent 89e0836f78
commit f363108425
13 files changed
+59 -130
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/getting_started/quickstart.md
+9 -1
View File
@@ -12,7 +12,15 @@ This guide will help you quickly get started with vLLM-Omni to perform:
## Installation
Please refer to [installation](installation/README.md)
For installation on GPU using pre-built-wheel:
```bash
uv venv --python 3.12 --seed
source .venv/bin/activate
uv pip install vllm==0.11.0 --torch-backend=auto
uv pip install vllm-omni
```
For additional details—including alternative installation methods, installation on NPU and other platforms — please see the installation guide in [installation](installation/README.md)
## Offline Inference