anodyine/vllm-omni

0 Fork 0

Files

T

History

3dc35694b3 [New model] Qwen-Image-2.1 support (rebase + review follow-ups) (#8099 )

Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: SamitHuang <285365963@qq.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>

2026-10-07 21:23:59 +08:00

benchmark

[Frontend][Benchmark] Add judger and accuracy metrics for OmniInterac… (#7317 )

2026-09-24 08:34:23 +00:00

__init__.py

[Benchmark][MiniCPM-o] Add Omni-DuplexEval support (#6634 )

2026-08-27 16:31:50 +08:00

logo.py

[Bugfix] Fix missing ANSI colors in CLI logo when output is piped (#1636 )

2026-05-06 15:43:19 +00:00

main.py

[Bugfix] Configure logging in the Omni CLI/API Server (#8518 )

2026-10-05 13:53:14 -04:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

serve.py

[New model] Qwen-Image-2.1 support (rebase + review follow-ups) (#8099 )

2026-10-07 21:23:59 +08:00

README.md

CLI Entrypoints

This package owns vLLM-Omni command-line integration.

What Belongs Here

Omni CLI command registration and dispatch.
CLI argument parsing and validation for vllm ... --omni.
Headless/runtime launch wiring that ultimately calls server bootstrap code.
CLI-only presentation helpers such as the logo.

What Does Not Belong Here

FastAPI route bodies.
OpenAI endpoint request helpers.
Server app utilities that are shared outside CLI; those belong under entrypoints/serve.

The CLI currently imports openai.api_server.omni_run_server. If server bootstrap moves later, update this import, but do not fold route helpers into the CLI package. Related endpoint cleanup is tracked by #5227.