[Docs] Add DLO component architecture
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
1 parent
6b7b5368f2
commit
4acb3b1387
2 files changed
+178
-3
No files matched your search
@@ -5,8 +5,9 @@ buffers instead of keeping the complete DiT in HBM. It supports sharded host
|
||||
weights with AllGather or independently streamed rank-local weights. The
|
||||
no-AllGather path can optionally share node-local runtime weights through mmap.
|
||||
|
||||
See the [DLO feature design](../../../design/feature/offloader/distributed_layerwise_offload.md)
|
||||
for loader contracts, compatibility details, failure handling, and benchmarks.
|
||||
See the [DLO component architecture](../../../design/feature/offloader/distributed_layerwise_offload.md#architecture)
|
||||
for ownership and lifecycle coordination, and the remaining feature design for
|
||||
loader contracts, compatibility details, failure handling, and benchmarks.
|
||||
|
||||
## Choose a mode
|
||||
|
||||
|
||||
Reference in new issue
Block a user