Gao Han
69fd466fba
Merge branch 'main' into feat/diffusion-prefetch-protection
2026-06-02 23:22:08 +08:00
Boopathy Kannappan
7c729e19d7
[Bugfix] Fix SD3 T5 truncation check device mismatch on long prompts ( #3949 )
...
Signed-off-by: bkannappan <bkannappan@digitalocean.com >
2026-06-02 11:04:08 +00:00
tzhouam
617c6ca55f
feat: enhance model loading with prefetching and retry logic
...
- Introduced `from_pretrained_with_prefetch` to handle racy cache scenarios by re-prefetching and retrying on failures.
- Updated various model pipelines to utilize the new prefetching mechanism, ensuring robust loading of model components.
- Prefetch logic added to multiple models, including HunyuanVideo, LongCatImage, and QwenImage, to mitigate issues with incomplete cache states.
2026-06-02 09:01:47 +00:00
Alex Brooks and Gao Han
ce8a7dfd2d
[Bugfix] Fix Dtype Crashes in SD3 ( #2526 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-08 16:05:38 +08:00
Zhou Taichang and Yuanheng Zhao
7f2b1e9386
[Rebase] Rebase to vllm 0.20.0 ( #3232 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-04-30 09:56:59 +12:00
fde4808723
[Performance] diffusion timing ( #1757 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-03-19 12:26:12 +08:00
dengyunyang
d275c0c993
[FEATURE] Tile/Patch parallelism refactor for easily support other models ( #1366 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-03-03 15:48:51 +08:00
Didan Deng and Hongsheng Liu
23cf48d7bb
[Perf]: CFG parallel abstraction ( #851 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-30 16:23:44 +00:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
dongbo910220
1467b3e2c7
[BugFix] Remove duplicate width assignment in SD3 pipeline ( #708 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
2026-01-09 08:34:17 +08:00
c9eace8371
[Model] Support stable diffusion3 ( #439 )
...
Signed-off-by: iwzbi <iwzbi@zju.edu.cn >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Co-authored-by: iwzbi <iwzbi@zju.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-27 21:51:03 +08:00
Gao Han