Files
vllm-omni/vllm_omni/edge/local/external/protocol.py
T
tzhouam 723c550209 Integrate portable edge graph backends with Omni runtime
Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.
2026-09-22 13:12:33 +08:00

18 lines
581 B
Python

# SPDX-License-Identifier: Apache-2.0
"""Compatibility import for the extracted host-copy wire implementation.
Standalone legacy worker scripts load this file directly. The source-tree
fallback loads only the portable package, never the vllm_omni initializer.
"""
import sys
from pathlib import Path
try:
from omni_stage_contracts.wire import * # noqa: F403
except ModuleNotFoundError as exc:
if exc.name != "omni_stage_contracts":
raise
sys.path.insert(0, str(Path(__file__).resolve().parents[4]))
from omni_stage_contracts.wire import * # noqa: F403