tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
Lancer
de3a291710
[Bugfix] fix OmniGen2 offload and dtype mismatch ( #2560 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Lancer <402430575@qq.com >
2026-05-09 09:13:37 +08:00
Nick Cao and Claude
65bc968465
[Refactor] Rename SupportsModuleOffload to SupportsComponentDiscovery ( #3354 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-08 14:16:49 +00:00
Nick Cao and Claude
e3b0afbb97
[Refactor] Let diffusion pipelines declare offloadable modules via SupportsModuleOffload ( #2427 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-23 04:23:00 +08:00
Zhang Jian
817e32d548
[Quantization] feat: add FP8 for Omnigen2 ( #2441 )
...
Signed-off-by: Zhang <jianmusings@gmail.com >
2026-04-16 23:33:40 +08:00
zhou zhuoxin
16041ab550
[Refactor] Extend CFG Parallel to support 3 or 4 branch dispatch across M GPUs ( #2423 )
2026-04-12 22:06:49 +08:00
R0CKSTAR
7a72f34ce4
Add supports_float64() to OmniPlatform and clean up MPS ( #2488 )
...
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com >
2026-04-07 11:15:02 +08:00
zhou zhuoxin and 汪志鹏
b147553d67
[Feature] add Tensor Parallelism to Omnigen2 ( #2065 )
...
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-23 11:46:58 +08:00
Yupu
cb6d012d91
[BugFix]: Fix OmniGen2 Model Loading ( #1711 )
...
Signed-off-by: Yupu <feng.yu.pu0330@gmail.com >
2026-03-22 23:13:13 +08:00
Joshna-Medisetty and gcanlin
ca6c7ad2be
Fix OmniGen2 transformer config loading for HF models ( #1934 )
...
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-03-19 10:21:54 +08:00
Yupu
c9786c5c0c
[Model] Support OmniGen2 ( #513 )
...
Signed-off-by: Yupu <feng.yu.pu0330@gmail.com >
2026-02-26 10:34:28 +00:00
tzhouam