From e9e1e77f49d799df85763d599900d9dfda38b28d Mon Sep 17 00:00:00 2001 From: Roger Wang Date: Wed, 3 Dec 2025 22:08:42 +0000 Subject: [PATCH] add dockerhub Signed-off-by: Roger Wang --- docs/getting_started/installation/gpu.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/docs/getting_started/installation/gpu.md b/docs/getting_started/installation/gpu.md index 4926f93f7..40f533aba 100644 --- a/docs/getting_started/installation/gpu.md +++ b/docs/getting_started/installation/gpu.md @@ -37,4 +37,9 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr ## Set up using Docker ### Pre-built images -To be released... Stay tuned! +vLLM-Omni offers an official docker image for deployment. These images are built on top of vLLM docker images +and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni +indicates which release of vLLM it is based on. + +!!! Tip + You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.