0 Fork 0

Files

T

ae58c2d8b9 [Model] YuE2: async single-stage synthesis and CUDA graph acceleration (#8407 )

Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Wang Zhipeng <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-02 05:17:06 -07:00

cli

[feature] Add HSDP pre-sharded option (#7948 )

2026-10-02 09:35:09 +00:00

duplex

[Bugfix] Break duplex OpenAI import cycle (#8287 )

2026-09-29 11:07:03 -04:00

openai

[Model] YuE2: async single-stage synthesis and CUDA graph acceleration (#8407 )

2026-10-02 05:17:06 -07:00

openpi

[Model] Add π0.5 (Pi0.5) VLA model support (#6950 )

2026-09-17 05:18:51 -07:00

serve

[BugFix] Add field constraints to /v1/omni/sleep and /v1/omni/wakeup (#4740 )

2026-09-28 09:30:30 -06:00

__init__.py

[Bug] Lazy-import entrypoints to fix subprocess pynvml crash (#2187 )

2026-04-09 15:35:22 +08:00

async_omni_base.py

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

async_omni.py

[Bugfix] Raise when a diffusion stage fails sleep or wake_up (#7811 )

2026-09-29 00:12:34 +08:00

client_request_state.py

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

duplex_omni.py

[Bugfix] Compensate cancelled duplex open, append and resume; fix serving README drift (#7636 Issues 1, 2, 3, 21) (#7785 )

2026-09-24 19:23:08 -07:00

omni_base.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

omni.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

pd_utils.py

[Bugfix] Remove stale OmniStage import and type annotation (#3541 )

2026-05-22 11:32:14 +08:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

stage_utils.py

[Core] Retain structured configs through runtime startup (#6849 )

2026-09-16 20:47:38 -07:00

utils.py

[Frontend] Scale Omni serving across API processes (#6923 )

2026-09-16 22:29:31 -07:00

README.md

Entrypoints

This package contains user-facing server, CLI, orchestration, and protocol entrypoints for vLLM-Omni.

What Belongs Here

Runtime orchestration entrypoints such as AsyncOmni, Omni, and request-state helpers.
CLI integration under cli/.
Shared cross-entrypoint configuration and stage utilities.

What Does Not Belong Here

OpenAI endpoint-family route bodies and request helpers; those should move toward openai/<family>/ packages as part of #5227.
Generic model execution internals that belong under engine, worker, or model executor packages.

Some top-level utility files remain acceptable homes under Phase 0.2 (P0.2) of #5227. They are not part of the OpenAI helper migration unless explicitly referenced by #5227.