Merge branch 'main' into dockerfile

Signed-off-by: Alicia Wang <115451386+congw729@users.noreply.github.com>

Dockerfile

@@ -0,0 +1,14 @@
+ARG VLLM_BASE_IMAGE=vllm/vllm-openai
+ARG VLLM_BASE_TAG=v0.11.0
+FROM ${VLLM_BASE_IMAGE}:${VLLM_BASE_TAG}
+ARG APP_DIR=/workspace/vllm-omni
+WORKDIR ${APP_DIR}
+
+COPY . .
+
+# Install vllm-omni into the same uv-managed Python environment used by the base image.
+RUN uv pip install --python "$(python3 -c 'import sys; print(sys.executable)')" --no-cache-dir .
+
+RUN ln -sf /usr/bin/python3 /usr/bin/python
+
+ENTRYPOINT ["vllm", "serve", "--omni"]

docs/getting_started/installation/gpu.md

@@ -37,9 +37,4 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr
 ## Set up using Docker
 
 ### Pre-built images
-vLLM-Omni offers an official docker image for deployment. These images are built on top of vLLM docker images
+To be released... Stay tuned!
-and available on Docker Hub as [vllm/vllm-omni](https://hub.docker.com/r/vllm/vllm-omni/tags). The version of vLLM-Omni
-indicates which release of vLLM it is based on.
-
-!!! tip
-    You can use this docker image to serve models the same way you would do in vLLM! To do so, make sure you overwrite the default entrypoint (`vllm serve --omni`) which works only for models supported in the vLLM-Omni project.