[Docs] Visualize no-AllGather shared host weights
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
1 parent
1ccdc2e80e
commit
47153d86e6
2 files changed
+182
No files matched your search
@@ -392,6 +392,14 @@ one and streams complete blocks using H2D copies only. The host backing may be
|
||||
a loader-approved checkpoint mapping, a normalized runtime-cache mapping, or
|
||||
ordinary runtime tensors.
|
||||
|
||||

|
||||
|
||||
The figure uses TP1 to make physical sharing explicit. With TP greater than
|
||||
one, the cache keeps one immutable entry per TP coordinate and equivalent
|
||||
workers in independent engines map the corresponding entry. An external
|
||||
router or orchestrator chooses each engine's requests; DLO coordinates only
|
||||
the worker-local mapping, hooks, transfer streams, events, and device slots.
|
||||
|
||||
For direct mmap, each process retains immutable safetensors views and uses two
|
||||
bounded pinned host staging slots. Processes on the same node that map the same
|
||||
files share physical checkpoint pages through the OS page cache. This removes
|
||||
|
||||
Reference in new issue
Block a user