typo

Signed-off-by: Roger Wang <hey@rogerw.io>
add dockerhub
2025-12-03 22:09:30 +00:00 · 2025-12-03 22:08:42 +00:00
1 changed files with 6 additions and 1 deletions
@@ -37,4 +37,9 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr
 ## Set up using Docker

 ### Pre-built images
-To be released... Stay tuned!
+vLLM-Omni offers an official docker image for deployment. These images are built on top of vLLM docker images
+and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni
+indicates which release of vLLM it is based on.
+
+!!! tip
+    You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.
Author	SHA1	Message	Date
Roger Wang	ed875fa1b2	typo Signed-off-by: Roger Wang <hey@rogerw.io>	2025-12-03 22:09:30 +00:00
Roger Wang	e9e1e77f49	add dockerhub Signed-off-by: Roger Wang <hey@rogerw.io>	2025-12-03 22:08:42 +00:00