tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
akshatvishu
1f3a3e3848
Fix Ovis image text encoder dtype ( #3876 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-05-28 08:21:37 +08:00
Yuanheng Zhao
8a55d3d01f
[Feat] Enable Layerwise CPU offloading for SD3.5, Ovis-Image, Nextstep_1, LongCat-Image ( #2339 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-08 09:55:09 +08:00
Dnoob
48b3969717
[Bugfix] Fix Ovis Image crash when guidance_scale is set without negative_prompt ( #1956 )
...
Signed-off-by: Dnoob <dxpouo@gmail.com >
2026-03-19 16:51:02 +08:00
fde4808723
[Performance] diffusion timing ( #1757 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-19 12:26:12 +08:00
675c35db97
[Refactor] lora: reuse load_weights packed mapping ( #991 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-03-04 02:58:43 +00:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
Yuanheng Zhao
2f5e32477c
[NFC] Remove redundant torch.no_grad in models and pipelines ( #854 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-01-27 12:36:54 +00:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
Jiangyun Zhu
c784b3e07d
[core] add torch compile for diffusion ( #684 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-01-09 04:05:44 +13:00
ApsarasX
89f47c910a
[Bugfix] Fix f-string formatting in image generation pipelines ( #689 )
...
Signed-off-by: ApsarasX <apsarax@outlook.com >
2026-01-07 14:12:58 +00:00
catcat
fd52647028
[Model] Replace diffusers apply_rotary_emb with omni RotaryEmbedding ( #496 )
...
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
2026-01-03 05:08:27 +13:00
dsinghvi and Hongsheng Liu
4586efe651
[Model] Ovis Image Model Addition ( #263 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-19 20:05:34 +08:00
tzhouam