[Docs] Show TP2 devices in DLO architecture
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
1 parent
3b9727c1e1
commit
649558e1a1
2 files changed
+102
-81
No files matched your search
@@ -394,11 +394,13 @@ ordinary runtime tensors.
|
||||
|
||||

|
||||
|
||||
The figure uses TP1 to make physical sharing explicit. With TP greater than
|
||||
one, the cache keeps one immutable entry per TP coordinate and equivalent
|
||||
workers in independent engines map the corresponding entry. An external
|
||||
router or orchestrator chooses each engine's requests; DLO coordinates only
|
||||
the worker-local mapping, hooks, transfer streams, events, and device slots.
|
||||
The figure uses TP2 to make per-coordinate physical sharing explicit. Each
|
||||
engine contains two rank-local workers and devices. The cache keeps one
|
||||
immutable entry per TP coordinate, so equivalent TP0 workers across engines
|
||||
share the TP0 entry and equivalent TP1 workers share the separate TP1 entry.
|
||||
An external router or orchestrator chooses each engine's requests; DLO
|
||||
coordinates only the worker-local mapping, hooks, transfer streams, events,
|
||||
and device slots.
|
||||
|
||||
For direct mmap, each process retains immutable safetensors views and uses two
|
||||
bounded pinned host staging slots. Processes on the same node that map the same
|
||||
|
||||
Reference in new issue
Block a user