24 lines
885 B
Markdown
24 lines
885 B
Markdown
# Serve Utilities
|
|
|
|
This directory is for server/app utilities shared by Omni entrypoints.
|
|
|
|
## Put Here
|
|
|
|
- FastAPI app/router mutation helpers (`routes.remove_route_from_app`,
|
|
`routes._remove_route_from_router`).
|
|
- Server exception-handler registration.
|
|
- Engine-failure helpers that are not owned by one endpoint family.
|
|
|
|
## Do Not Put Here
|
|
|
|
- Endpoint restriction *policy* (which routes a pipeline shuts down, and why).
|
|
That stays in `vllm_omni.config.endpoint_policy`; the policy module should
|
|
*call* `remove_route_from_app` from here, not redefine it.
|
|
- OpenAI response-shape adapters. Those belong under
|
|
`vllm_omni.entrypoints.openai`.
|
|
- Modality validation or payload parsing.
|
|
- Generic helpers without a clear server/app responsibility.
|
|
|
|
Keep this directory aligned with the spirit of upstream
|
|
`vllm.entrypoints.serve.utils`. Broader utility cleanup is tracked by #5227.
|