[Refactor] P0.2: Migrate API server helpers out of api_server (#5453)
Signed-off-by: herotai214 <herotai214@gmail.com>
This commit is contained in:
1 parent
aff7d64948
commit
bbac4df7d3
47 files changed
+2437
-1744
No files matched your search
@@ -0,0 +1,21 @@
|
||||
# CLI Entrypoints
|
||||
|
||||
This package owns vLLM-Omni command-line integration.
|
||||
|
||||
## What Belongs Here
|
||||
|
||||
- Omni CLI command registration and dispatch.
|
||||
- CLI argument parsing and validation for `vllm ... --omni`.
|
||||
- Headless/runtime launch wiring that ultimately calls server bootstrap code.
|
||||
- CLI-only presentation helpers such as the logo.
|
||||
|
||||
## What Does Not Belong Here
|
||||
|
||||
- FastAPI route bodies.
|
||||
- OpenAI endpoint request helpers.
|
||||
- Server app utilities that are shared outside CLI; those belong under
|
||||
`entrypoints/serve`.
|
||||
|
||||
The CLI currently imports `openai.api_server.omni_run_server`. If server
|
||||
bootstrap moves later, update this import, but do not fold route helpers into
|
||||
the CLI package. Related endpoint cleanup is tracked by #5227.
|
||||
@@ -0,0 +1,18 @@
|
||||
# Benchmark CLI
|
||||
|
||||
This package owns Omni benchmark subcommands exposed through the CLI.
|
||||
|
||||
## What Belongs Here
|
||||
|
||||
- CLI parser extensions for benchmark commands.
|
||||
- Benchmark command dispatch.
|
||||
- Benchmark-only argument groups.
|
||||
|
||||
## What Does Not Belong Here
|
||||
|
||||
- Runtime server route helpers.
|
||||
- OpenAI endpoint implementation details.
|
||||
- Benchmark execution internals that belong under `vllm_omni.benchmarks`.
|
||||
|
||||
This package is not part of the OpenAI endpoint helper migration. It may need
|
||||
import updates only if CLI/bootstrap ownership changes during #5227.
|
||||
Reference in new issue
Block a user