Gao Han
69fd466fba
Merge branch 'main' into feat/diffusion-prefetch-protection
2026-06-02 23:22:08 +08:00
Boopathy Kannappan
7c729e19d7
[Bugfix] Fix SD3 T5 truncation check device mismatch on long prompts ( #3949 )
...
Signed-off-by: bkannappan <bkannappan@digitalocean.com >
2026-06-02 11:04:08 +00:00
tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
Alex Brooks and Gao Han
ce8a7dfd2d
[Bugfix] Fix Dtype Crashes in SD3 ( #2526 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-08 16:05:38 +08:00
Zhou Taichang and Yuanheng Zhao
7f2b1e9386
[Rebase] Rebase to vllm 0.20.0 ( #3232 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-04-30 09:56:59 +12:00
Yuanheng Zhao
8a55d3d01f
[Feat] Enable Layerwise CPU offloading for SD3.5, Ovis-Image, Nextstep_1, LongCat-Image ( #2339 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-08 09:55:09 +08:00
fde4808723
[Performance] diffusion timing ( #1757 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-19 12:26:12 +08:00
SYLAR
75056b2db2
[Bugfix] Fix SD3.5-medium attn2 uninitialized weights ( #1659 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
2026-03-13 14:58:17 +08:00
675c35db97
[Refactor] lora: reuse load_weights packed mapping ( #991 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
2026-03-04 02:58:43 +00:00
dengyunyang
d275c0c993
[FEATURE] Tile/Patch parallelism refactor for easily support other models ( #1366 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-03 15:48:51 +08:00
Sihao Li
71c9e77606
[Feature] add Tensor Parallelism to SD_3.5 ( #1336 )
...
Signed-off-by: GG-li <3226868735@qq.com >
2026-02-12 07:33:23 +00:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
catcat
e9a1beec77
[Bugfix] Fix stable diffusion3 compatibility error ( #772 )
...
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
2026-01-13 21:12:32 +08:00
dongbo910220
1467b3e2c7
[BugFix] Remove duplicate width assignment in SD3 pipeline ( #708 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
2026-01-09 08:34:17 +08:00
Jiangyun Zhu
c784b3e07d
[core] add torch compile for diffusion ( #684 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-01-09 04:05:44 +13:00
c9eace8371
[Model] Support stable diffusion3 ( #439 )
...
Signed-off-by: iwzbi <iwzbi@zju.edu.cn >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Co-authored-by: iwzbi <iwzbi@zju.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-27 21:51:03 +08:00
Gao Han