vllm-omni/vllm_omni/entrypoints/serve/utils

Serve Utilities

This directory is for server/app utilities shared by Omni entrypoints.

Put Here

• FastAPI app/router mutation helpers (routes.remove_route_from_app, routes._remove_route_from_router).
• Server exception-handler registration.
• Engine-failure helpers that are not owned by one endpoint family.

Do Not Put Here

• Endpoint restriction policy (which routes a pipeline shuts down, and why). That stays in vllm_omni.config.endpoint_policy; the policy module should call remove_route_from_app from here, not redefine it.
• OpenAI response-shape adapters. Those belong under vllm_omni.entrypoints.openai.
• Modality validation or payload parsing.
• Generic helpers without a clear server/app responsibility.

Keep this directory aligned with the spirit of upstream vllm.entrypoints.serve.utils. Broader utility cleanup is tracked by #5227.