Isotr0py
44ea27c809
fix pre-commit
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-23 06:22:17 +00:00
Isotr0py
0c82bb1315
Gate persistent DiT staging on decode-graph models
...
ModelLevelOffloadBackend passed persistent_dit_staging=(device is CUDA) for
every model, so Qwen-Image 2.0/FLUX/WAN-style sequential offload kept DiT
device storage alive across swaps instead of freeing VRAM. Only retain
staging when a DiT actually captures weight pointers (enable_cuda_graph_decode);
other models keep plain move semantics. Add tests pinning both behaviors.
2026-09-22 08:58:32 +00:00
Isotr0py
5b540f55d3
Fix decode cuda graph for Qwen-Image-2.1 model-level cpu offload ( #7801 )
2026-09-19 00:10:53 +08:00
SYLAR
ea3cf99894
[diffusion][feature] Add component-selective offload policies ( #5929 )
...
Signed-off-by: lishunyang12 <lishunyang12@163.com >
2026-09-06 05:40:09 +08:00
R0CKSTAR
260db8bab5
[Bugfix][Diffusion] Fix MiniMax-H3 model-level CPU offload residency ( #6072 )
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2026-08-21 10:30:53 +00:00
Rahul Steiger
66b9ad287a
Extend Cosmos3 CPU offloading to component and layerwise paths ( #4695 )
2026-07-13 09:48:53 +00:00
Yuanheng Zhao
e0cdbe9a5d
[Misc] Cleanup: use consistent pytest-mock in unit tests ( #2698 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-13 19:21:42 +08:00
Lancer and gcanlin
4cfa9bf843
[Bugfix] fix offload and hsdp incompatibility ( #1888 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-03-24 14:50:57 +08:00
Isotr0py