0 Fork 0

Files

T

maithilijoshi20 f1a6e7ce2a [Core] Retain structured configs through runtime startup (#6849 )

Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>

2026-09-16 20:47:38 -07:00

omni_control

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

profile

[Core] Retain structured configs through runtime startup (#6849 )

2026-09-16 20:47:38 -07:00

utils

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

__init__.py

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

README.md

Serve Entrypoint Helpers

This package contains server-level helpers for assembling and operating the HTTP/FastAPI serving process.

What Belongs Here

Helpers that are about the server app rather than a public OpenAI endpoint family.
Operational route packages such as profiling and Omni control.
Shared server utilities that mirror upstream vllm.entrypoints.serve.utils concepts.

What Does Not Belong Here

OpenAI protocol schemas or response bodies.
Image, video, audio, or streaming-input request parsing.
Serving model implementations.

Endpoint-family route bodies are still staged in openai/api_server.py during the P0.2 helper migration. Route ownership (P0.3) and final folder cleanup (Phase 1) are tracked by #5227.