tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
Yuanheng Zhao
8a55d3d01f
[Feat] Enable Layerwise CPU offloading for SD3.5, Ovis-Image, Nextstep_1, LongCat-Image ( #2339 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-08 09:55:09 +08:00
fde4808723
[Performance] diffusion timing ( #1757 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-19 12:26:12 +08:00
Alex Brooks and Didan Deng
c8cf8a799d
[Refactor] Use SP Plan for LongCat Sequence Parallelism ( #1772 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-13 11:13:34 +08:00
Alex Brooks
fa944bd8e8
[BugFix] Fix LongCat Sequence Parallelism / Small Cleanup ( #1631 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-03-05 17:31:00 +08:00
Lancer
4082202484
[chore] add _repeated_blocks for regional compilation support ( #1642 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-03-04 14:26:06 +08:00
675c35db97
[Refactor] lora: reuse load_weights packed mapping ( #991 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-03-04 02:58:43 +00:00
Alex Brooks and SYLAR
a09b6499f8
[Bugfix][Model] Fix LongCat Image Config Handling / Layer Creation ( #1485 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-03-03 00:50:08 +08:00
Zeyu Huang | 黃澤宇 and Hongsheng Liu
7672298075
bugfix: /images/edits endpoint fails pipeline data format check ( #1141 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-04 09:36:57 +08:00
Rustam Khadipash
dc6177520e
[Feature] add Tensor Parallelism to LongCat-Image(-Edit) ( #926 )
...
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com >
2026-02-02 10:28:25 +00:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Canlin Guo
c9392dff01
[Hardware] Support platforms and plugin system ( #774 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-28 22:12:52 +08:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
XU Mingshi
8c7f704c23
[Diffusion][Feature] Implement SP support in LongCatImageTransformer ( #721 )
...
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
2026-01-12 00:22:50 -08:00
Jiangyun Zhu
c784b3e07d
[core] add torch compile for diffusion ( #684 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-01-09 04:05:44 +13:00
ApsarasX
89f47c910a
[Bugfix] Fix f-string formatting in image generation pipelines ( #689 )
...
Signed-off-by: ApsarasX <apsarax@outlook.com >
2026-01-07 14:12:58 +00:00
927d952405
bugfix: fix longcat-image cache dispatch ( #638 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: DefTruth <qiustudent_r@163.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: SamitHuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com >
2026-01-05 16:25:20 +08:00
catcat
fd52647028
[Model] Replace diffusers apply_rotary_emb with omni RotaryEmbedding ( #496 )
...
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
2026-01-03 05:08:27 +13:00
elijah and huangxulong
ef827022b8
[Model] Add LongCat-Image-Edit support ( #392 )
...
Signed-off-by: huangxulong <huangxulong@oschina.cn >
Signed-off-by: elijah <f1renze.142857@gmail.com >
Co-authored-by: huangxulong <huangxulong@oschina.cn >
2025-12-22 21:31:50 +08:00
elijah and huangxulong
b5e50d552a
[Model] Add LongCat-Image support ( #291 )
...
Signed-off-by: elijah <f1renze.142857@gmail.com >
Signed-off-by: huangxulong <huangxulong@oschina.cn >
Co-authored-by: huangxulong <huangxulong@oschina.cn >
2025-12-18 15:35:27 +00:00
tzhouam