Yufeng Zhu
424fa3fcfc
Address review comments (benchmark logs, ids, and design comments)
...
Signed-off-by: Yufeng Zhu <yzhu802@gatech.edu >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-05-29 02:34:52 +00:00
Zhengyuan Su and Claude Opus 4.6
e1834ab19b
[Enhancement] Fix SP path for MoT fused kernels, address review feedback
...
Rebase MoT fused kernels (PR #1328 ) onto current main and fix issues:
- Rewrite _forward_sp_gen() to use MoT unified API instead of deleted
*_moe_gen layers (qkv_proj_moe_gen, o_proj_moe_gen, q_norm_moe_gen,
k_norm_moe_gen), which caused AttributeError when SP was active
- Parameterize bias in MoT kernel tests (ZJY0516 review feedback)
- Add configs/ directory with README documenting the 3-tier config
loading mechanism (ZJY0516 review feedback)
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu >
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-05-29 02:34:52 +00:00
Yufeng Zhu
f9ba582747
enhancement: add mot fused kernels and benchmarks 01
...
Signed-off-by: Yufeng Zhu <yzhu802@gatech.edu >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-05-29 02:34:51 +00:00
rein yang
1c876f0cd1
[Perf] Trim Code2Wav CUDA Graph buckets for Qwen3-TTS single-GPU deploy ( #3932 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
2026-05-28 17:26:57 +08:00
Nick Cao and Claude
c20afebce4
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively ( #3360 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-28 16:20:49 +08:00
Liang Lv
b72ffb82bb
[AutoRound] Support GLM-Image W4A16 quantization model ( #3059 )
...
Signed-off-by: lvliang-intel <liang1.lv@intel.com >
2026-05-28 07:19:06 +00:00
JackyLiu
168033cac0
[Bugfix] Remove duplicate ffmpeg options in random video generation ( #3923 )
...
Signed-off-by: JLiu4Coding <lzwgre@126.com >
2026-05-28 14:57:59 +08:00
JiangJie Zhang
6fa9dbbe42
[Diffusion] Unify diffusion request identity on request_id ( #3744 )
...
Signed-off-by: jader <yjader@foxmail.com >
2026-05-28 14:56:56 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
0f3264a9c0
[Perf][Bugfix] cache hot buffers in qwen3_tts talker; fall back on evicted state ( #3688 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-28 05:45:54 +00:00
BeatSeat
dab596e468
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules ( #3886 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
2026-05-27 23:41:35 -05:00
mglyn
2b999429c4
[Feature] Add cfg-parallel for LTX-2.3 ( #3905 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-28 04:36:33 +00:00
WeiQing Chen
6031c7d393
[CI] Add HunyuanVideo 1.5 X2V accuracy tests ( #3852 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-28 11:09:45 +08:00
373d3c7476
[Blackwell] Add CUDNN_ATTN and FLASHINFER_ATTN backends for diffusion (auto-route) ( #3079 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Co-authored-by: frauttauteffasu <247219357+frauttauteffasu@users.noreply.github.com >
Co-authored-by: Zhang Jian <jianmusings@gmail.com >
2026-05-28 11:09:25 +08:00
Chendi.Xue
1903cee56a
[MXFP8][XPU] enable mxfp8 using vLLM main repo method ( #3782 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
2026-05-28 02:47:22 +00:00
Yuanheng Zhao
39705f9ee8
[Feat] Support online quantization (fp8/int8) for DreamID-Omni ( #3902 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-28 02:31:58 +00:00
Ziming Huang and tzhouam
220ce0b4ea
[Test] Add long text output correctness test for Qwen3-Omni ( #3539 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: tzhouam <tzhouam@connect.ust.hk >
2026-05-28 08:27:29 +08:00
Lancer and Alicia
5c3c81920b
[Bugfix] Ensure stage and diffusion subprocesses exit when parent dies unexpectedly ( #3751 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-05-28 08:22:04 +08:00
akshatvishu
1f3a3e3848
Fix Ovis image text encoder dtype ( #3876 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-05-28 08:21:37 +08:00
Sy03 and Yueqian Lin
d37912b071
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving ( #3773 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-27 13:25:49 -05:00
Haco and zzhuoxin1508
37eebff674
[BugFix] Fix diffusion parallel_config YAML override and add deploy config field allowlist ( #3483 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: zzhuoxin1508 <zzhuoxin1508@users.noreply.github.com >
2026-05-28 01:00:32 +08:00
a698269e47
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage ( #2875 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-05-27 23:21:20 +08:00
JohnJan
36dc32ff81
[Feature] support SP for FLUX.2-dev ( #3244 )
2026-05-27 20:43:02 +08:00
Aleksi Vesanto
9abf9545df
[ROCm] Add support for AITER GroupNorm ( #3419 )
...
Signed-off-by: Aleksi Vesanto <avesanto@amd.com >
2026-05-27 11:33:17 +00:00
bjf-frz and Hongsheng Liu
c33ef34654
[Bugfix]Fix Hunyuan Image3 denoise flow alignment ( #3857 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-27 19:18:01 +08:00
rongfu.leng and Peter Pan
c349f62839
[Feat] opt qwen image model load use ColumnParallelLinear replace ReplicatedLinear ( #3875 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
Co-authored-by: Peter Pan <Peter.Pan@daocloud.io >
2026-05-27 09:02:17 +00:00
WeiQing Chen and SYLAR
41cb6378a2
[Perf] Trim HunyuanVideo encoder padding tokens ( #3844 )
...
Signed-off-by: david6666666 <530634352@qq.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-27 14:17:10 +08:00
Jason and Zeyu Huang | 黃澤宇
753508fe02
[Bugfix] Fix Qwen-Image-Edit-2511 TeaCache zero_cond_t handling ( #3219 )
...
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
2026-05-27 11:06:18 +08:00
TaffyOfficial and TaffyOfficial
3c48257f8d
[Feat][HunyuanImage3] Stream AR text for IT2I image edits ( #3723 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-05-27 12:27:11 +12:00
283873411a
glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config ( #3235 )
...
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-27 12:18:47 +12:00
Dan
1f1c82ecdd
[BugFix] Fix Qwen3-TTS Code2Wav compatibility with transformers >= 5.9.0 ( #3880 )
...
Signed-off-by: Dan250124 <416947747@qq.com >
2026-05-26 16:24:43 +00:00
mglyn
385df0359e
[BugFix] Fix LTX-2.3 audio latent padding for sequence parallelism ( #3854 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-26 08:45:38 +00:00
Zheng Wengang and Hongsheng Liu
cad25fa20c
[CI] Add nightly-ci for multi-stage deployment ( #3610 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-26 11:16:43 +08:00
NumberWan
11a951b962
[BugFix]: CUDA device-side assert failures on single-stage BAGEL i2i requests ( #3680 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
2026-05-26 03:01:10 +00:00
Canlin Guo
52020c7af7
[UX] Rename default config to hunyuan_image_3_moe ( #3835 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-26 01:41:15 +08:00
8f45e68bcd
[Higgs-Audio] bosonai/higgs-audio-v2-generation-3B-base TTS model support ( #3762 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-25 23:16:07 +08:00
rongfu.leng
80dea88007
[Bugfix] fix when diffusion model not set sleeping_stages ( #3023 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
thanks
2026-05-25 23:13:38 +08:00
Yueqian Lin and Rein Yang
e996723bc9
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness ( #3665 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
the ci failure case is irrelavent to this PR and occurs rarely
2026-05-25 23:09:38 +08:00
Canlin Guo and Hongsheng Liu
c890b3a99c
[BugFix][NPU] Honor prefer_model_sampler in NPU AR runner ( #3517 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-25 09:08:18 +08:00
Alex Brooks
cc0e15ba57
[Bugfix] Fix LTX2 CacheDiT Integration ( #3621 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-24 21:55:34 +08:00
BeatSeat and Yueqian Lin
28ce618f0e
[Model] Add GLM-TTS text-to-speech model support ( #3141 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-24 05:42:26 +08:00
amy-why-3459 and Hongsheng Liu
748470c1fb
[BugFix] code2wav supports disabling CUDA graph. ( #3732 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-24 00:05:55 +08:00
fywc
d01eaca39a
[Feat] support cache-dit for DreamID-Omni ( #3265 )
...
Signed-off-by: hanzheli <hanzheli@kuaishou.com >
Signed-off-by: fywc <hanzheli@kuaishou.com >
2026-05-23 08:09:33 +08:00
e7644daa7f
[Perf] [OmniVoice] Triton kernel fusion + CUDA Graph acceleration ( #3336 )
...
Signed-off-by: univa-HARRY <harry@univa.co.kr >
Signed-off-by: Harry <harry@univa.co.kr >
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-22 13:12:47 +00:00
Yueqian Lin
d714b4ce04
[Recipe] Add Fish Speech S2 Pro 2-GPU deploy profile ( #3323 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-22 20:14:03 +08:00
Alex Brooks
23e243378f
[Bugfix] Set separate CFG flag in Helios for CacheDiT ( #3756 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-22 19:56:41 +08:00
Jialong Liu and Hongsheng Liu
5799d85a51
[Bugfix] Revert MiMo-Audio local_sampler to greedy to fix text truncation under concurrent batching (followup to #3686 ) ( #3817 )
...
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-22 19:25:37 +08:00
skf
90ed618b5a
[Bugfix] Align Offline and Online Inference ( #3506 )
2026-05-22 16:08:04 +08:00
ANHDY and wangmengdi
28467dc19a
[feature]: support Hidream-I1-Full model ( #2572 )
...
Signed-off-by: wangmengdi <160612767@qq.com >
Co-authored-by: wangmengdi <wangmengdi@cmss.chinamobile.com >
2026-05-22 15:23:03 +08:00
Zeng Chuang and Claude Opus 4.7
f0af3ab200
[BugFix] Fix prefer_model_sampler token history in async scheduling ( #3681 )
...
Signed-off-by: zengchuang <zengchuang3@huawei.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
2026-05-22 14:29:46 +08:00