[Performance] Add per-component DLO offload policy
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
This commit is contained in:
1 parent
780e8d40aa
commit
7db3a0cd5e
15 files changed
+324
-21
No files matched your search
@@ -795,6 +795,9 @@ class OmniDiffusionConfig:
|
||||
dlo_use_allgather: bool = True
|
||||
# Leading main-DiT blocks kept resident by distributed layerwise offload.
|
||||
dlo_resident_layers: int = 0
|
||||
# Auxiliary encoder/VAE policy. False keeps the whole component resident;
|
||||
# DiT offload remains owned by DLO.
|
||||
dlo_offload_components: dict[str, bool] = field(default_factory=dict)
|
||||
# Final-layout Host Weight Runtime policy. The loader only activates this
|
||||
# for eligible no-AllGather DLO; all other configurations preserve their
|
||||
# existing loader/storage path.
|
||||
|
||||
Reference in new issue
Block a user