Hongsheng Liu
3bb7547a0f
[Diffusion] Rename runtime cache to host weight cache
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-19 11:23:36 +08:00
Hongsheng Liu
23ab14a15b
[Diffusion] Register runtime cache for direct DLO H2D
...
Avoid recurrent mmap-to-pinned packing in no-AllGather DLO by registering transform-complete runtime-cache mappings under an explicit per-worker budget. Copy mapped tensors directly into the rotating device buffers while preserving bounded-staging fallback and ordered shutdown cleanup.
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-19 11:21:28 +08:00
Hongsheng Liu
9d2bb23ff6
[Diffusion] Add loader-owned host-weight plans for DLO (TP=1) ( #6213 )
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-16 11:02:38 +08:00
SYLAR and lishunyang12
1c2a81f6d8
feat(minimax-h3): enable 2x RTX 4090/5090 with DLO ( #5764 )
...
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
2026-08-06 09:02:29 +08:00
evanchueng and david6666666
744c65b730
[Feature] Distributed layerwise offload with DP multi-concurrency + mmap weight… ( #5397 )
...
Signed-off-by: evanchueng <evanchueng@outlook.com >
Signed-off-by: david6666666 <530634352@qq.com >
Co-authored-by: david6666666 <530634352@qq.com >
2026-07-30 13:35:38 +00:00
Lancer and gcanlin
4cfa9bf843
[Bugfix] fix offload and hsdp incompatibility ( #1888 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-03-24 14:50:57 +08:00
Yuanheng Zhao and Samit
8bf849c399
Refactor CPU Offloading Backend Pattern ( #1223 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-02-12 17:29:55 +08:00
Hongsheng Liu