Files
vllm-omni/packages/omni-stage-contracts
tzhouam 723c550209 Integrate portable edge graph backends with Omni runtime
Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.
2026-09-22 13:12:33 +08:00
..

Omni stage contracts

Versioned, dependency-free data contracts for local Omni stage adapters. The optional wire extra provides the NumPy copied-host tensor transport. Importing the contracts never imports torch, vLLM or vLLM-Omni.

Build from this directory with uv build; both the wheel and source archive contain the canonical package. The parent Omni distribution bundles the same source for compatibility. Install matching releases when using both distributions.