vllm-omni

3,057 Commits 235 Branches 31 Tags

2 Commits

Include renames

Author	SHA1	Message	Date
tzhouam	723c550209	Integrate portable edge graph backends with Omni runtime Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.	2026-09-22 13:12:33 +08:00
tzhouamandClaude Fable 5.1	4e3e8a1ebc	[edge-infer] WIP snapshot: uncommitted M0/W1/W4/W5 edge work as of 2026-09-18 Verbatim copy of the edge/omni-edge working tree (tracked diffs + untracked edge/local, tests/edge/local, docs/edge, pipeline files). Taken so that vLLM-Omni v0.29.0rc1 can be merged on a branch without touching the user's working tree. logs_edge/ and benchmark .npy outputs excluded. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>	2026-09-18 09:47:29 +08:00

Author

SHA1

Message

Date

tzhouam

723c550209

Integrate portable edge graph backends with Omni runtime

Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.

2026-09-22 13:12:33 +08:00

tzhouamandClaude Fable 5.1

4e3e8a1ebc

[edge-infer] WIP snapshot: uncommitted M0/W1/W4/W5 edge work as of 2026-09-18

Verbatim copy of the edge/omni-edge working tree (tracked diffs + untracked
edge/local, tests/edge/local, docs/edge, pipeline files). Taken so that
vLLM-Omni v0.29.0rc1 can be merged on a branch without touching the
user's working tree. logs_edge/ and benchmark .npy outputs excluded.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-18 09:47:29 +08:00