anodyine/vllm-omni

0 Fork 0

Files

T

History

3dc35694b3 [New model] Qwen-Image-2.1 support (rebase + review follow-ups) (#8099 )

Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: SamitHuang <285365963@qq.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>

2026-10-07 21:23:59 +08:00

cli

[New model] Qwen-Image-2.1 support (rebase + review follow-ups) (#8099 )

2026-10-07 21:23:59 +08:00

duplex

[Core] Generalized turn-based /v1/realtime implementation (#8339 )

2026-10-06 22:07:31 +08:00

openai

[New model] Qwen-Image-2.1 support (rebase + review follow-ups) (#8099 )

2026-10-07 21:23:59 +08:00

openpi

[Model] Add π0.5 (Pi0.5) VLA model support (#6950 )

2026-09-17 05:18:51 -07:00

serve

[BugFix] Add field constraints to /v1/omni/sleep and /v1/omni/wakeup (#4740 )

2026-09-28 09:30:30 -06:00

__init__.py

[Bug] Lazy-import entrypoints to fix subprocess pynvml crash (#2187 )

2026-04-09 15:35:22 +08:00

async_omni_base.py

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

async_omni.py

[Bugfix] Validate sleep stage_ids before blocking admission (#8501 )

2026-10-05 10:27:53 -04:00

client_request_state.py

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

duplex_omni.py

[Core][Frontend] Bound duplex output delivery and reject cancelled audio (#7644 )

2026-10-04 14:06:04 -07:00

omni_base.py

[Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213 )

2026-10-02 18:03:14 +00:00

omni.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

pd_utils.py

[Bugfix] Remove stale OmniStage import and type annotation (#3541 )

2026-05-22 11:32:14 +08:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

stage_utils.py

[Core] Retain structured configs through runtime startup (#6849 )

2026-09-16 20:47:38 -07:00

utils.py

[Frontend] Scale Omni serving across API processes (#6923 )

2026-09-16 22:29:31 -07:00

README.md

Entrypoints

This package contains user-facing server, CLI, orchestration, and protocol entrypoints for vLLM-Omni.

What Belongs Here

Runtime orchestration entrypoints such as AsyncOmni, Omni, and request-state helpers.
CLI integration under cli/.
Shared cross-entrypoint configuration and stage utilities.

What Does Not Belong Here

OpenAI endpoint-family route bodies and request helpers; those should move toward openai/<family>/ packages as part of #5227.
Generic model execution internals that belong under engine, worker, or model executor packages.

Some top-level utility files remain acceptable homes under Phase 0.2 (P0.2) of #5227. They are not part of the OpenAI helper migration unless explicitly referenced by #5227.