diff --git a/examples/offline_inference/qwen_2_5_omni/README.md b/examples/offline_inference/qwen_2_5_omni/README.md index f6b3a4fdb..e981edfd5 100644 --- a/examples/offline_inference/qwen_2_5_omni/README.md +++ b/examples/offline_inference/qwen_2_5_omni/README.md @@ -6,7 +6,7 @@ Use Docker to keep consistent basic environment (Optional, Recommended) ```bash -docker run --gpus all --ipc=host --network=host -v $source_dir:$container_dir --rm --name $container_name -it nvcr.io/nvidia/pytorch:25.01-py3 bash +docker run --gpus all --ipc=host --network=host -v $source_dir:$container_dir --name $container_name -it nvcr.io/nvidia/pytorch:25.01-py3 bash ``` Set up basic uv environment @@ -25,7 +25,7 @@ uv pip install vllm==0.11.0 --torch-backend=auto ### Installation of vLLM (for developers) -Install stable release version of vllm with 0.11.0 +If you want to check or debug with source code of vLLM, install stable release version of vllm with 0.11.0 from source with pre-built wheel file. ```bash git clone https://github.com/vllm-project/vllm.git @@ -48,6 +48,12 @@ uv pip install -r requirements/build.txt uv pip install --no-build-isolation --editable . ``` +### Verification for successful installation of vLLM +Just run the command below. If no error, it demonstrates that the installation is successfull. +```bash +python -c "import vllm._C" +``` + ### Installation of vLLM-omni Install additional requirements for vllm-omni ```bash