Signed-off-by: Roger Wang <hey@rogerw.io>
This commit is contained in:
Roger Wang committed 2025-12-03 22:09:30 +00:00
1 parent e9e1e77f49
commit ed875fa1b2
1 file changed
+1 -1
+1 -1
View File
@@ -41,5 +41,5 @@ vLLM-Omni offers an official docker image for deployment. These images are built
and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni
indicates which release of vLLM it is based on.
!!! Tip
!!! tip
You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.