tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
WeiQing Chen
67bb9b4a12
[CI][Bugfix] Fix LTX audio-video warmup output typing ( #3964 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-29 07:46:02 +00:00
mglyn
2b999429c4
[Feature] Add cfg-parallel for LTX-2.3 ( #3905 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-28 04:36:33 +00:00
373d3c7476
[Blackwell] Add CUDNN_ATTN and FLASHINFER_ATTN backends for diffusion (auto-route) ( #3079 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Co-authored-by: frauttauteffasu <247219357+frauttauteffasu@users.noreply.github.com >
Co-authored-by: Zhang Jian <jianmusings@gmail.com >
2026-05-28 11:09:25 +08:00
mglyn
385df0359e
[BugFix] Fix LTX-2.3 audio latent padding for sequence parallelism ( #3854 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-26 08:45:38 +00:00
Alex Brooks
cc0e15ba57
[Bugfix] Fix LTX2 CacheDiT Integration ( #3621 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-24 21:55:34 +08:00
Yuanheng Zhao
2bc9cb7f13
[Feat] Support online quantization (fp8/int8) for LTX-2 ( #3700 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-05-21 19:52:21 +08:00
Yuanheng Zhao
220db62b3f
[Bugfix] Adapt LTX-2 connector arg with diffusers 0.38.0 ( #3661 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-17 21:58:44 +08:00
Nick Cao and Claude
65bc968465
[Refactor] Rename SupportsModuleOffload to SupportsComponentDiscovery ( #3354 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-08 14:16:49 +00:00
Nick Cao
e6466cf0e6
[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. ( #3365 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-07 23:23:59 +08:00
Ricardo Noriega
05c6c9a0b6
feat: add LTX-2.3 video generation model support ( #2893 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
2026-04-23 16:51:51 +08:00
Nick Cao and Claude
e3b0afbb97
[Refactor] Let diffusion pipelines declare offloadable modules via SupportsModuleOffload ( #2427 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-23 04:23:00 +08:00
Ayush Agarwal
dc8a9e2f17
[Model] feat: FastGen DMD2-distilled Wan 2.1 pipelines (T2V, I2V) ( #2749 )
...
Signed-off-by: ayushag <ayushag@nvidia.com >
2026-04-20 21:21:43 +08:00
fywc
d613864dbf
[Model] Add HSDP support for LTX-2 ( #2899 )
...
Signed-off-by: hanzheli <hanzheli@kuaishou.com >
Signed-off-by: fywc <hanzheli@kuaishou.com >
2026-04-20 18:51:16 +08:00
Yuanheng Zhao and Didan Deng
68f28f9631
[Feat] Support layerwise CPU offloading for more videogen models ( #2018 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-20 00:43:53 +08:00
Yangshen Deng and Claude Opus 4.6
1cd5210440
[Diffusion] Refactor LTX2 to use unified CFG parallel framework ( #2160 )
...
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-08 11:44:04 +08:00
Jerry Song
cd71567b06
[Model] Add two stages inference for model LTX-2 distilled. ( #2260 )
...
Signed-off-by: Songrui625 <songrui625@gmail.com >
2026-04-03 23:17:49 +08:00
WeiQing Chen
83fe7d005b
[Model] support LTX-2 text-to-video image-to-video ( #841 )
...
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-03-05 23:31:48 +08:00
tzhouam