Files
vllm-omni/vllm_omni/host/__init__.py
T
tzhouam 723c550209 Integrate portable edge graph backends with Omni runtime
Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.
2026-09-22 13:12:33 +08:00

3 lines
108 B
Python

# SPDX-License-Identifier: Apache-2.0
"""Host mechanics, independent of accelerator and model selection."""