0 Fork 0

Files

T

MaciejBalaNVandHongsheng Liu 05ab509269 Cosmos3 action policy improvements (#6460 )

Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-09-10 22:32:50 +08:00

cli

Cosmos3 action policy improvements (#6460 )

2026-09-10 22:32:50 +08:00

duplex

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

openai

Cosmos3 action policy improvements (#6460 )

2026-09-10 22:32:50 +08:00

openpi

Cosmos3 action policy improvements (#6460 )

2026-09-10 22:32:50 +08:00

serve

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

__init__.py

[Bug] Lazy-import entrypoints to fix subprocess pynvml crash (#2187 )

2026-04-09 15:35:22 +08:00

async_omni.py

[Rebase] Rebase to vLLM 0.29.0 (#7230 )

2026-09-10 12:08:28 +08:00

client_request_state.py

text and image metric (#6150 )

2026-08-26 02:54:45 +00:00

duplex_request_client.py

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196 )

2026-09-05 08:20:21 +00:00

omni_base.py

[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202 )

2026-09-09 13:02:12 -07:00

omni.py

text and image metric (#6150 )

2026-08-26 02:54:45 +00:00

pd_utils.py

[Bugfix] Remove stale OmniStage import and type annotation (#3541 )

2026-05-22 11:32:14 +08:00

README.md

[Refactor] P0.2: Migrate API server helpers out of api_server (#5453 )

2026-09-10 15:03:21 +08:00

stage_utils.py

[Bugfix] Fix colocate-async sleep admission race and deliver AR abort tokens (#6367 )

2026-08-29 09:11:39 +00:00

utils.py

[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202 )

2026-09-09 13:02:12 -07:00

README.md

Entrypoints

This package contains user-facing server, CLI, orchestration, and protocol entrypoints for vLLM-Omni.

What Belongs Here

Runtime orchestration entrypoints such as AsyncOmni, Omni, and request-state helpers.
CLI integration under cli/.
Shared cross-entrypoint configuration and stage utilities.

What Does Not Belong Here

OpenAI endpoint-family route bodies and request helpers; those should move toward openai/<family>/ packages as part of #5227.
Generic model execution internals that belong under engine, worker, or model executor packages.

Some top-level utility files remain acceptable homes under Phase 0.2 (P0.2) of #5227. They are not part of the OpenAI helper migration unless explicitly referenced by #5227.