tzhouamandClaude Fable 5.1 74acd66307 [Edge][WP7] Add CudaIpcConnector (CUDA IPC for device tensor leaves over shm control plane) ...

Wraps SharedMemoryConnector: CUDA tensor leaves are exported with
torch.multiprocessing reduce_tensor + an inter-process CUDA event, rebuilt and
cloned by the consumer, released by the producer after an ack file appears.
CPU leaves and metadata keep the shm path. Registered as "CudaIpcConnector";
deploy/qwen3_tts_cuda_ipc.yaml selects it for the talker->code2wav hop.
Adoption in the edge profile is measurement-gated (hop latency bench).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-09 14:41:33 +08:00

..

omni_connectors

[Edge][WP7] Add CudaIpcConnector (CUDA IPC for device tensor leaves over shm control plane)

2026-09-09 14:41:33 +08:00

omni_coordinator

[Refactor] Omni Stage Runtime and Distributed Replica Control Plane (#3855)

2026-06-17 14:13:20 +08:00