add dockerhub

Signed-off-by: Roger Wang <hey@rogerw.io>
This commit is contained in:
Roger Wang committed 2025-12-03 22:08:42 +00:00
1 parent 598d26580e
commit e9e1e77f49
1 file changed
+6 -1
+6 -1
View File
@@ -37,4 +37,9 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr
## Set up using Docker
### Pre-built images
To be released... Stay tuned!
vLLM-Omni offers an official docker image for deployment. These images are built on top of vLLM docker images
and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni
indicates which release of vLLM it is based on.
!!! Tip
You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.