diff --git a/docs/getting_started/installation/gpu.md b/docs/getting_started/installation/gpu.md index 4926f93f7..40f533aba 100644 --- a/docs/getting_started/installation/gpu.md +++ b/docs/getting_started/installation/gpu.md @@ -37,4 +37,9 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr ## Set up using Docker ### Pre-built images -To be released... Stay tuned! +vLLM-Omni offers an official docker image for deployment. These images are built on top of vLLM docker images +and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni +indicates which release of vLLM it is based on. + +!!! Tip + You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.