anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[NPU] upgrade to v0.30.0 (#8027)

Browse Source 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
This commit is contained in:
Weiming Liao authored and GitHub committed 2026-09-23 14:59:29 +00:00
1 parent d319d276f9
commit 81bc7116c1
6 files changed
+22 -21
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/getting_started/installation/npu/npu.inc.md
+11 -11
View File
@@ -10,25 +10,25 @@ The recommended way to use vLLM-Omni on NPU is through the vLLM-Ascend pre-built
=== "A2"
```bash
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.29.0
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.30.0
```
=== "A3"
```bash
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.29.0-a3
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.30.0-a3
```
=== "A5"
```bash
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.29.0-a5
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.30.0-a5
```
=== "310P (Experimental)"
```bash
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.29.0-310p
export IMAGE=quay.io/atlas-ci/vllm-ascend:v0.30.0-310p
```
```bash
@@ -53,7 +53,7 @@ docker run --rm \
# Inside the container, install vLLM-Omni from source
cd /vllm-workspace
git clone -b v0.29.0rc1 https://github.com/vllm-project/vllm-omni.git
git clone -b v0.30.0rc1 https://github.com/vllm-project/vllm-omni.git
cd vllm-omni
pip install -v -e . --no-build-isolation
# or VLLM_OMNI_TARGET_DEVICE=npu pip install -v -e .
@@ -71,10 +71,10 @@ We are keeping [issue #886](https://github.com/vllm-project/vllm-omni/issues/886
# --8<-- [start:installation-main]
You can also install vLLM-Omni from the latest main branch if you want to use the latest features or bug fixes. Use the aligned vLLM-Ascend v0.29.0 image described above, and check [issue #886](https://github.com/vllm-project/vllm-omni/issues/886) for the status of the latest vLLM-Omni commit on NPU.
You can also install vLLM-Omni from the latest main branch if you want to use the latest features or bug fixes. Use the aligned vLLM-Ascend v0.30.0 image described above, and check [issue #886](https://github.com/vllm-project/vllm-omni/issues/886) for the status of the latest vLLM-Omni commit on NPU.
```bash
# Inside the vLLM-Ascend v0.29.0 container, install vLLM-Omni from main
# Inside the vLLM-Ascend v0.30.0 container, install vLLM-Omni from main
cd /vllm-workspace
git clone https://github.com/vllm-project/vllm-omni.git
cd vllm-omni
@@ -103,7 +103,7 @@ Here's an example deployment command that has been verified on 4 x NPUs:
=== "A2"
```bash
export IMAGE=quay.io/ascend/vllm-omni:v0.29.0
export IMAGE=quay.io/ascend/vllm-omni:v0.30.0
docker run --rm \
--name vllm-omni-a2 \
--shm-size=64g \
@@ -127,7 +127,7 @@ Here's an example deployment command that has been verified on 4 x NPUs:
=== "A3"
```bash
export IMAGE=quay.io/ascend/vllm-omni:v0.29.0-a3
export IMAGE=quay.io/ascend/vllm-omni:v0.30.0-a3
docker run --rm \
--name vllm-omni-a3 \
--shm-size=64g \
@@ -151,7 +151,7 @@ Here's an example deployment command that has been verified on 4 x NPUs:
=== "A5"
```bash
export IMAGE=quay.io/ascend/vllm-omni:v0.29.0-a5
export IMAGE=quay.io/ascend/vllm-omni:v0.30.0-a5
docker run --rm \
--name vllm-omni-a5 \
--shm-size=64g \
@@ -175,7 +175,7 @@ Here's an example deployment command that has been verified on 4 x NPUs:
=== "310P (Experimental)"
```bash
export IMAGE=quay.io/ascend/vllm-omni:v0.29.0-310p
export IMAGE=quay.io/ascend/vllm-omni:v0.30.0-310p
docker run --rm \
--name vllm-omni-310p \
--shm-size=64g \