supplement some infomation

Signed-off-by: Gaohan123 <gaohan19@huawei.com>
This commit is contained in:
Gaohan123 committed 2025-11-05 10:46:05 +08:00
1 parent 6e1478222e
commit 5b683c75de
1 file changed
+8 -2
+8 -2
View File
@@ -42,7 +42,7 @@ vLLM-omni is built on a modular architecture that extends vLLM's core functional
Use Docker to keep consistent basic environment (Optional, Recommended)
```bash
docker run --gpus all --ipc=host --network=host -v $source_dir:$container_dir --rm --name $container_name -it nvcr.io/nvidia/pytorch:25.01-py3 bash
docker run --gpus all --ipc=host --network=host -v $source_dir:$container_dir --name $container_name -it nvcr.io/nvidia/pytorch:25.01-py3 bash
```
Set up basic uv environment
@@ -61,7 +61,7 @@ uv pip install vllm==0.11.0 --torch-backend=auto
### Installation of vLLM (for developers)
Install stable release version of vllm with 0.11.0
If you want to check or debug with source code of vLLM, install stable release version of vllm with 0.11.0 from source with pre-built wheel file.
```bash
git clone https://github.com/vllm-project/vllm.git
@@ -84,6 +84,12 @@ uv pip install -r requirements/build.txt
uv pip install --no-build-isolation --editable .
```
### Verification for successful installation of vLLM
Just run the command below. If no error, it demonstrates that the installation is successfull.
```bash
python -c "import vllm._C"
```
### Installation of vLLM-omni
Install additional requirements for vllm-omni
```bash