Files
vllm-omni/tests/diffusion/offloader
Isotr0py 0c82bb1315 Gate persistent DiT staging on decode-graph models
ModelLevelOffloadBackend passed persistent_dit_staging=(device is CUDA) for
every model, so Qwen-Image 2.0/FLUX/WAN-style sequential offload kept DiT
device storage alive across swaps instead of freeing VRAM. Only retain
staging when a DiT actually captures weight pointers (enable_cuda_graph_decode);
other models keep plain move semantics. Add tests pinning both behaviors.
2026-09-22 08:58:32 +00:00
..