anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,082 Commits 235 Branches 31 Tags
4d6124f3202f17384e52de082688175f1df8bb6e
Commit Graph
3082 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
tzhouam 4d6124f320 Record SA8775P CPU vocoder placement and timing 2026-09-24 08:06:23 +08:00
tzhouam f04fdf79da Track CPU talker controls and mobile speech-head profiles 2026-09-24 08:01:05 +08:00
tzhouam d71d39f656 Audit mobile speech heads and S25 VLA latent impact 2026-09-24 07:56:17 +08:00
tzhouam 1949c31f80 Advance Qualcomm TTS and InternVLA component qualification 2026-09-24 07:32:21 +08:00
tzhouam ea373e3cbf Audit X Elite CPU vocoder and isolate TFLite conversion parity 2026-09-24 07:16:15 +08:00
tzhouam e4a4477929 Update device-model matrix with Qualcomm TTS component evidence 2026-09-24 07:04:24 +08:00
tzhouam 152d67ab86 Audit Qualcomm Qwen3-TTS vocoder parity and profile 2026-09-24 06:48:14 +08:00
tzhouam bd39e903e1 Profile Spark attention across Qualcomm edge devices 2026-09-24 06:11:15 +08:00
tzhouam d5c1f2bdc1 Qualify Spark GGUF Omni stage on WSL CPU 2026-09-24 05:05:21 +08:00
tzhouam 36ef53d9b1 Profile MiniCPM-o native storage and probe InternVLA AMD NPU 2026-09-24 04:51:30 +08:00
tzhouam e5c4449a8f Add admitted InternVLA CUDA policy on WSL and native Windows 2026-09-24 03:55:29 +08:00
tzhouam 60d07a8afd Record native Windows MiniCPM-o CPU control and unstable latency 2026-09-24 03:18:27 +08:00
tzhouam ddb8635cfe Store MiniCPM worker evidence as non-executable logs 2026-09-24 03:09:53 +08:00
tzhouam c5f47b22fd Profile repeated Radeon MiniCPM-o requests and record memory regression 2026-09-24 03:09:21 +08:00
tzhouam 5dd5d70671 Profile native Windows Radeon InternVLA policy stage 2026-09-24 02:24:16 +08:00
tzhouam 752357d318 Profile native Windows CPU InternVLA through Omni 2026-09-24 02:05:26 +08:00
tzhouam 48646da78e Add admitted InternVLA policy stages and update device matrix 2026-09-24 01:42:41 +08:00
tzhouam 9df5ac8836 Run InternVLA synthetic policy with Radeon Cosmos handoff 2026-09-24 01:12:27 +08:00
tzhouam b796c787ec Profile InternVLA Cosmos encoder on Radeon 890M and update matrix 2026-09-24 00:51:17 +08:00
tzhouam e6ea35ca12 Qualify scoped WSL CPU Qwen3-TTS Omni complete requests 2026-09-24 00:41:14 +08:00
tzhouam 10ae2818c7 Profile MiniCPM-o GGUF Omni complete path on WSL CPU 2026-09-24 00:21:11 +08:00
tzhouam fa5aadca6f Record MiniCPM-o GGUF Omni desktop qualification depth 2026-09-23 23:02:10 +08:00
tzhouam 0a41206e1f Add Omni MiniCPM-o GGUF whole-session CPU and Radeon paths 2026-09-23 23:01:22 +08:00
tzhouam 13cc723c71 Qualify scoped MiniCPM-o Radeon hybrid path 2026-09-23 22:43:20 +08:00
tzhouam 445ca92ef1 Record MiniCPM-o CPU GGUF complete-path evidence 2026-09-23 22:22:54 +08:00
tzhouam bb8735effc Add native Windows CPU Qwen TTS Omni stage and profile evidence 2026-09-23 21:18:21 +08:00
tzhouam 8569995591 Add bounded Omni Qwen3-TTS CPU Radeon whole-session stage 2026-09-23 20:52:43 +08:00
tzhouam 34beb7f01e Add bounded Omni llama.cpp Spark text stage for Windows CPU and Radeon 2026-09-23 20:30:28 +08:00
tzhouam 4fee1dbe39 Profile Qwen3-TTS hybrid Radeon and CPU route 2026-09-23 19:59:04 +08:00
tzhouam 54c086acae Record native Windows CPU Qwen3-TTS scoped E2E evidence 2026-09-23 19:19:13 +08:00
tzhouam 03d6cb9a93 Qualify standalone Spark text on Windows CPU and Radeon 890M 2026-09-23 18:57:41 +08:00
tzhouam 34295f3eb3 Qualify Spark output-head component on AMD NPU and update E2E matrix 2026-09-23 18:32:13 +08:00
tzhouam 10221f0665 Qualify scoped MiniCPM-o image and audio paths on WSL CPU 2026-09-23 17:44:02 +08:00
tzhouam b29a6ca99f Document Windows MiniCPM-o image and audio end-to-end runs 2026-09-23 17:29:13 +08:00
tzhouam a8fdb1babf Validate MiniCPM-o audio input to speech on WSL GPU 2026-09-23 17:09:37 +08:00
tzhouam 0d00ba4701 Validate MiniCPM-o image to speech on WSL GPU 2026-09-23 17:03:31 +08:00
tzhouam 8a4559c46c Validate MiniCPM-o speech pipeline on native Windows GPU 2026-09-23 16:54:17 +08:00
tzhouam 2f5d0edcf7 Qualify scoped MiniCPM-o CPU speech and Windows InternVLA policy paths 2026-09-23 16:21:28 +08:00
tzhouam 3f2cd52939 Update E2E matrix with scoped recovery evidence 2026-09-23 15:24:43 +08:00
tzhouam c0deaa76ba Repair MiniCPM-o and InternVLA scoped E2E paths 2026-09-23 15:15:07 +08:00
tzhouam 2d8b1d4583 Resume and hash-verify pending E2E checkpoints 2026-09-23 10:34:41 +08:00
tzhouam e0142926b6 Document MiniCPM-o checkpoint preflight and current deploy layout 2026-09-23 10:19:10 +08:00
tzhouam b039b6a5bd Enable scoped Qwen3.8 Omni inference and CPU TTS compatibility 2026-09-23 10:01:21 +08:00
tzhouam 75b65f859b Add local E2E profiling evidence and support roadmap 2026-09-22 19:25:02 +08:00
tzhouam ab2f2a3d65 Audit all mobile and PC model pairings with archived evidence 2026-09-22 13:54:34 +08:00
tzhouam 1887d8294b Present support as mobile and PC by model matrix 2026-09-22 13:31:08 +08:00
tzhouam 5c75d5bb0a Document support as model and PC configuration pairings 2026-09-22 13:20:50 +08:00
tzhouam 723c550209 Integrate portable edge graph backends with Omni runtime 
Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.
 2026-09-22 13:12:33 +08:00
tzhouamandClaude Fable 5.1 00510ce38b [edge-infer] vllm_omni.windows: host-OS compatibility plugin for native Windows 
One package that makes the POSIX assumptions measured in W0-W8 hold in
every process vLLM / vLLM-Omni starts, and reports what it did:
- provides fcntl (flock/lockf on msvcrt.locking; LOCK_SH served as
  exclusive) and uvloop (asyncio.run on a selector loop) when absent;
- installs WindowsSelectorEventLoopPolicy and a signal.signal fallback
  for loop.add_signal_handler on the Windows loop classes;
- replaces whole vLLM's get_open_zmq_ipc_path / find_loaded_library when
  the wheel lacks the branch patch and the upstream body hash is known;
- verifies the wheel-only sites (sentinel poll, int64 seed) and reports
  wheel_required at the exact site instead of failing downstream;
- shm_dir() replaces the /dev/shm literals; os.geteuid provided.
Activated from vllm_omni/patch.py and as vllm.general_plugins /
vllm_omni.general_plugins entry points (idempotent; no-op off Windows).
 prints the audit; the M0 placement
report embeds it. 16 Linux tests through injected primitives.
Design: analysis/design_windows_compat_plugin_20260921.md

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-21 14:02:01 +08:00
tzhouamandClaude Fable 5.1 97d97b6503 [edge-infer W8] Omni serve CLI: uvloop optional, selector-loop asyncio.run on Windows 
uvloop ships no Windows wheels, so 'import uvloop' at module scope in
entrypoints/cli/serve.py killed vllm-omni serve on Windows at import
(measured in the serving e2e after the fcntl fix). _run_forever() uses
uvloop where present and asyncio.run on WindowsSelectorEventLoopPolicy
otherwise, which zmq.asyncio needs. The remaining serve-import blocker
on the Windows venv was a missing dependency, torchaudio (vLLM's own
requirement), installed into the venvs rather than patched.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-18 19:09:22 +08:00