From 60c150040ecf25d38b087b30325e1cbd6fe541fc Mon Sep 17 00:00:00 2001 From: "rongfu.leng" Date: Sun, 31 May 2026 15:44:08 +0000 Subject: [PATCH] [Feat]upgrade vllm version Signed-off-by: rongfu.leng --- docs/getting_started/installation/gpu/cuda.inc.md | 4 ++-- docs/getting_started/installation/gpu/rocm.inc.md | 4 ++-- docs/getting_started/quickstart.md | 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/docs/getting_started/installation/gpu/cuda.inc.md b/docs/getting_started/installation/gpu/cuda.inc.md index 9f3c86843..3e436e471 100644 --- a/docs/getting_started/installation/gpu/cuda.inc.md +++ b/docs/getting_started/installation/gpu/cuda.inc.md @@ -20,7 +20,7 @@ Therefore, it is recommended to install vLLM and vLLM-Omni with a **fresh new** vLLM-Omni is built based on vLLM. Please install it with command below. ```bash -uv pip install vllm==0.21.0 --torch-backend=auto +uv pip install vllm==0.22.0 --torch-backend=auto ``` #### Installation of vLLM-Omni @@ -42,7 +42,7 @@ uv pip install 'vllm-omni[demo]' If you do not need to modify source code of vLLM, you can directly install the stable 0.21.0 release version of the library ```bash -uv pip install vllm==0.21.0 --torch-backend=auto +uv pip install vllm==0.22.0 --torch-backend=auto ``` The 0.21.0 release of vLLM ships CUDA 13.0-compatible binaries by default. If you need a different CUDA variant or want to reuse an existing PyTorch installation, build vLLM from source instead. diff --git a/docs/getting_started/installation/gpu/rocm.inc.md b/docs/getting_started/installation/gpu/rocm.inc.md index f563f2f11..4e8f688d0 100644 --- a/docs/getting_started/installation/gpu/rocm.inc.md +++ b/docs/getting_started/installation/gpu/rocm.inc.md @@ -13,7 +13,7 @@ vLLM-Omni current recommends the steps in under setup through Docker Images. vLLM-Omni is built based on vLLM. Please install it with command below. ```bash -uv pip install vllm==0.21.0+rocm722 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm722 +uv pip install vllm==0.22.0+rocm722 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm722 ``` #### Installation of vLLM-Omni @@ -37,7 +37,7 @@ uv pip install onnxruntime-rocm If you do not need to modify source code of vLLM, you can directly install the stable 0.21.0 release version of the library ```bash -uv pip install vllm==0.21.0+rocm722 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm722 +uv pip install vllm==0.22.0+rocm722 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm722 ``` The pre-built 0.21.0 vLLM wheel targets ROCm 7.2.2. If you need a different ROCm stack or want to reuse an existing PyTorch installation, build vLLM from source instead. diff --git a/docs/getting_started/quickstart.md b/docs/getting_started/quickstart.md index 10665f2c2..13a4161b9 100644 --- a/docs/getting_started/quickstart.md +++ b/docs/getting_started/quickstart.md @@ -19,10 +19,10 @@ uv venv --python 3.12 --seed source .venv/bin/activate # On CUDA -uv pip install vllm==0.21.0 --torch-backend=auto +uv pip install vllm==0.22.0 --torch-backend=auto # On ROCm -uv pip install vllm==0.21.0+rocm721 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm721 +uv pip install vllm==0.22.0+rocm721 --extra-index-url https://wheels.vllm.ai/rocm/0.21.0/rocm721 git clone https://github.com/vllm-project/vllm-omni.git cd vllm-omni