|
c69ed4037d
|
[feat] Support prompt embedding caching for diffusion model (#2962)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-29 15:36:03 +08:00 |
|
|
Alex Brooks
|
68a1d23e4d
|
[Bugfix/Feature] Remove Hardcoded Flash Attention in Bagel & Support GQA in SDPA Backend (#3728)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-05-29 10:36:15 +08:00 |
|
|
Chen-Yo Sun
|
593c4c06aa
|
[BugFix] Avoid Voxtral TTS loading error msg (#3951)
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
|
2026-05-29 02:35:01 +00:00 |
|
|
amy-why-3459
|
5dd1d0a772
|
[BugFix] Fix prefix-caching issue (#3726)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-05-29 01:51:54 +00:00 |
|
|
Dakai An
|
bb9f21d0db
|
Fix Qwen3-omni accuracy degradation from deepstack inputs under torch.compile (#3885)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-05-28 23:57:56 +08:00 |
|
|
knlnguyen1802andSamit
|
5eac50f22c
|
[bugfix, rl] Fix sleep do not release full memory in custom pipeline (#3818)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-05-28 22:27:27 +08:00 |
|
|
|
126fb4b4a9
|
[Blackwell][1/N] Add SageAttention3 diffusion backend on blackwell(GB200/B200/RTX5090/PRO6000/DGX Spark available) (#3015)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-05-28 14:08:45 +00:00 |
|
|
rein yang
|
1c876f0cd1
|
[Perf] Trim Code2Wav CUDA Graph buckets for Qwen3-TTS single-GPU deploy (#3932)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-05-28 17:26:57 +08:00 |
|
|
Nick CaoandClaude
|
c20afebce4
|
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively (#3360)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-28 16:20:49 +08:00 |
|
|
Liang Lv
|
b72ffb82bb
|
[AutoRound] Support GLM-Image W4A16 quantization model (#3059)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
|
2026-05-28 07:19:06 +00:00 |
|
|
JackyLiu
|
168033cac0
|
[Bugfix] Remove duplicate ffmpeg options in random video generation (#3923)
Signed-off-by: JLiu4Coding <lzwgre@126.com>
|
2026-05-28 14:57:59 +08:00 |
|
|
JiangJie Zhang
|
6fa9dbbe42
|
[Diffusion] Unify diffusion request identity on request_id (#3744)
Signed-off-by: jader <yjader@foxmail.com>
|
2026-05-28 14:56:56 +08:00 |
|
|
NATURE
|
3a347b10b0
|
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode (#3719)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-05-28 14:06:41 +08:00 |
|
|
|
0f3264a9c0
|
[Perf][Bugfix] cache hot buffers in qwen3_tts talker; fall back on evicted state (#3688)
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-28 05:45:54 +00:00 |
|
|
BeatSeat
|
dab596e468
|
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules (#3886)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
|
2026-05-27 23:41:35 -05:00 |
|
|
mglyn
|
2b999429c4
|
[Feature] Add cfg-parallel for LTX-2.3 (#3905)
Signed-off-by: mglyn <1203789601@qq.com>
|
2026-05-28 04:36:33 +00:00 |
|
|
WeiQing Chen
|
6031c7d393
|
[CI] Add HunyuanVideo 1.5 X2V accuracy tests (#3852)
Signed-off-by: david6666666 <530634352@qq.com>
|
2026-05-28 11:09:45 +08:00 |
|
|
|
373d3c7476
|
[Blackwell] Add CUDNN_ATTN and FLASHINFER_ATTN backends for diffusion (auto-route) (#3079)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Zhang <jianmusings@gmail.com>
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Co-authored-by: frauttauteffasu <247219357+frauttauteffasu@users.noreply.github.com>
Co-authored-by: Zhang Jian <jianmusings@gmail.com>
|
2026-05-28 11:09:25 +08:00 |
|
|
Chendi.Xue
|
1903cee56a
|
[MXFP8][XPU] enable mxfp8 using vLLM main repo method (#3782)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
|
2026-05-28 02:47:22 +00:00 |
|
|
Yuanheng Zhao
|
39705f9ee8
|
[Feat] Support online quantization (fp8/int8) for DreamID-Omni (#3902)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-05-28 02:31:58 +00:00 |
|
|
Ziming Huangandtzhouam
|
220ce0b4ea
|
[Test] Add long text output correctness test for Qwen3-Omni (#3539)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-05-28 08:27:29 +08:00 |
|
|
LancerandAlicia
|
5c3c81920b
|
[Bugfix] Ensure stage and diffusion subprocesses exit when parent dies unexpectedly (#3751)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-05-28 08:22:04 +08:00 |
|
|
akshatvishu
|
1f3a3e3848
|
Fix Ovis image text encoder dtype (#3876)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
|
2026-05-28 08:21:37 +08:00 |
|
|
Sy03andYueqian Lin
|
d37912b071
|
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving (#3773)
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-27 13:25:49 -05:00 |
|
|
Hacoandzzhuoxin1508
|
37eebff674
|
[BugFix] Fix diffusion parallel_config YAML override and add deploy config field allowlist (#3483)
Signed-off-by: xiaohajiayou <923390377@qq.com>
Co-authored-by: zzhuoxin1508 <zzhuoxin1508@users.noreply.github.com>
|
2026-05-28 01:00:32 +08:00 |
|
|
|
a698269e47
|
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage (#2875)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
|
2026-05-27 23:21:20 +08:00 |
|
|
JohnJan
|
36dc32ff81
|
[Feature] support SP for FLUX.2-dev (#3244)
|
2026-05-27 20:43:02 +08:00 |
|
|
Aleksi Vesanto
|
9abf9545df
|
[ROCm] Add support for AITER GroupNorm (#3419)
Signed-off-by: Aleksi Vesanto <avesanto@amd.com>
|
2026-05-27 11:33:17 +00:00 |
|
|
bjf-frzandHongsheng Liu
|
c33ef34654
|
[Bugfix]Fix Hunyuan Image3 denoise flow alignment (#3857)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-27 19:18:01 +08:00 |
|
|
rongfu.lengandPeter Pan
|
c349f62839
|
[Feat] opt qwen image model load use ColumnParallelLinear replace ReplicatedLinear (#3875)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Peter Pan <Peter.Pan@daocloud.io>
|
2026-05-27 09:02:17 +00:00 |
|
|
WeiQing ChenandSYLAR
|
41cb6378a2
|
[Perf] Trim HunyuanVideo encoder padding tokens (#3844)
Signed-off-by: david6666666 <530634352@qq.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-05-27 14:17:10 +08:00 |
|
|
JasonandZeyu Huang | 黃澤宇
|
753508fe02
|
[Bugfix] Fix Qwen-Image-Edit-2511 TeaCache zero_cond_t handling (#3219)
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn>
Signed-off-by: Jason <72191212+JasonJ2021@users.noreply.github.com>
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com>
|
2026-05-27 11:06:18 +08:00 |
|
|
TaffyOfficialandTaffyOfficial
|
3c48257f8d
|
[Feat][HunyuanImage3] Stream AR text for IT2I image edits (#3723)
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
|
2026-05-27 12:27:11 +12:00 |
|
|
|
283873411a
|
glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config (#3235)
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-27 12:18:47 +12:00 |
|
|
Dan
|
1f1c82ecdd
|
[BugFix] Fix Qwen3-TTS Code2Wav compatibility with transformers >= 5.9.0 (#3880)
Signed-off-by: Dan250124 <416947747@qq.com>
|
2026-05-26 16:24:43 +00:00 |
|
|
mglyn
|
385df0359e
|
[BugFix] Fix LTX-2.3 audio latent padding for sequence parallelism (#3854)
Signed-off-by: mglyn <1203789601@qq.com>
|
2026-05-26 08:45:38 +00:00 |
|
|
Zheng WengangandHongsheng Liu
|
cad25fa20c
|
[CI] Add nightly-ci for multi-stage deployment (#3610)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-26 11:16:43 +08:00 |
|
|
NumberWan
|
11a951b962
|
[BugFix]: CUDA device-side assert failures on single-stage BAGEL i2i requests (#3680)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-05-26 03:01:10 +00:00 |
|
|
Canlin Guo
|
52020c7af7
|
[UX] Rename default config to hunyuan_image_3_moe (#3835)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-05-26 01:41:15 +08:00 |
|
|
|
8f45e68bcd
|
[Higgs-Audio] bosonai/higgs-audio-v2-generation-3B-base TTS model support (#3762)
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-25 23:16:07 +08:00 |
|
|
rongfu.leng
|
80dea88007
|
[Bugfix] fix when diffusion model not set sleeping_stages (#3023)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
thanks
|
2026-05-25 23:13:38 +08:00 |
|
|
Yueqian LinandRein Yang
|
e996723bc9
|
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness (#3665)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
the ci failure case is irrelavent to this PR and occurs rarely
|
2026-05-25 23:09:38 +08:00 |
|
|
Canlin GuoandHongsheng Liu
|
c890b3a99c
|
[BugFix][NPU] Honor prefer_model_sampler in NPU AR runner (#3517)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-25 09:08:18 +08:00 |
|
|
Alex Brooks
|
cc0e15ba57
|
[Bugfix] Fix LTX2 CacheDiT Integration (#3621)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-05-24 21:55:34 +08:00 |
|
|
BeatSeatandYueqian Lin
|
28ce618f0e
|
[Model] Add GLM-TTS text-to-speech model support (#3141)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-24 05:42:26 +08:00 |
|
|
amy-why-3459andHongsheng Liu
|
748470c1fb
|
[BugFix] code2wav supports disabling CUDA graph. (#3732)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-24 00:05:55 +08:00 |
|
|
fywc
|
d01eaca39a
|
[Feat] support cache-dit for DreamID-Omni (#3265)
Signed-off-by: hanzheli <hanzheli@kuaishou.com>
Signed-off-by: fywc <hanzheli@kuaishou.com>
|
2026-05-23 08:09:33 +08:00 |
|
|
|
e7644daa7f
|
[Perf] [OmniVoice] Triton kernel fusion + CUDA Graph acceleration (#3336)
Signed-off-by: univa-HARRY <harry@univa.co.kr>
Signed-off-by: Harry <harry@univa.co.kr>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-22 13:12:47 +00:00 |
|
|
Yueqian Lin
|
d714b4ce04
|
[Recipe] Add Fish Speech S2 Pro 2-GPU deploy profile (#3323)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-05-22 20:14:03 +08:00 |
|
|
Alex Brooks
|
23e243378f
|
[Bugfix] Set separate CFG flag in Helios for CacheDiT (#3756)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-05-22 19:56:41 +08:00 |
|