[Refactor] P0.2: Migrate API server helpers out of api_server (#5453)

Signed-off-by: herotai214 <herotai214@gmail.com>
This commit is contained in:
herotai214 authored and GitHub committed 2026-09-10 15:03:21 +08:00
1 parent aff7d64948
commit bbac4df7d3
47 files changed
+2437 -1744

No files matched your search

+21
View File
@@ -0,0 +1,21 @@
# CLI Entrypoints
This package owns vLLM-Omni command-line integration.
## What Belongs Here
- Omni CLI command registration and dispatch.
- CLI argument parsing and validation for `vllm ... --omni`.
- Headless/runtime launch wiring that ultimately calls server bootstrap code.
- CLI-only presentation helpers such as the logo.
## What Does Not Belong Here
- FastAPI route bodies.
- OpenAI endpoint request helpers.
- Server app utilities that are shared outside CLI; those belong under
`entrypoints/serve`.
The CLI currently imports `openai.api_server.omni_run_server`. If server
bootstrap moves later, update this import, but do not fold route helpers into
the CLI package. Related endpoint cleanup is tracked by #5227.
@@ -0,0 +1,18 @@
# Benchmark CLI
This package owns Omni benchmark subcommands exposed through the CLI.
## What Belongs Here
- CLI parser extensions for benchmark commands.
- Benchmark command dispatch.
- Benchmark-only argument groups.
## What Does Not Belong Here
- Runtime server route helpers.
- OpenAI endpoint implementation details.
- Benchmark execution internals that belong under `vllm_omni.benchmarks`.
This package is not part of the OpenAI endpoint helper migration. It may need
import updates only if CLI/bootstrap ownership changes during #5227.