0 Fork 0

Files

T

chickeytonandClaude Opus 5 99ff4f3070 [Core][Frontend] Unified Full-duplex Framework (#7413 )

Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 15:35:36 +08:00

cli

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

duplex

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

openai

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

openpi

[P0][RFC #3747 ] RL rollout serving: session management + world_model_env (#4770 )

2026-09-14 09:26:44 +08:00

serve

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

__init__.py

[Bug] Lazy-import entrypoints to fix subprocess pynvml crash (#2187 )

2026-04-09 15:35:22 +08:00

async_omni_base.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

async_omni.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

client_request_state.py

[Bugfix] Fix host-memory leak on aborted /v1/images/generations (#6462 ) (#6561 )

2026-09-11 00:04:08 +00:00

duplex_omni.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

omni_base.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

omni.py

[Core][Frontend] Unified Full-duplex Framework (#7413 )

2026-09-16 15:35:36 +08:00

pd_utils.py

[Bugfix] Remove stale OmniStage import and type annotation (#3541 )

2026-05-22 11:32:14 +08:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

stage_utils.py

[Bugfix] Fix colocate-async sleep admission race and deliver AR abort tokens (#6367 )

2026-08-29 09:11:39 +00:00

utils.py

[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202 )

2026-09-09 13:02:12 -07:00

README.md

Entrypoints

This package contains user-facing server, CLI, orchestration, and protocol entrypoints for vLLM-Omni.

What Belongs Here

Runtime orchestration entrypoints such as AsyncOmni, Omni, and request-state helpers.
CLI integration under cli/.
Shared cross-entrypoint configuration and stage utilities.

What Does Not Belong Here

OpenAI endpoint-family route bodies and request helpers; those should move toward openai/<family>/ packages as part of #5227.
Generic model execution internals that belong under engine, worker, or model executor packages.

Some top-level utility files remain acceptable homes under Phase 0.2 (P0.2) of #5227. They are not part of the OpenAI helper migration unless explicitly referenced by #5227.