 QianCyrus
|
099f9b553d
|
[Model] Optimize Wan VAE first-frame decoding with Conv2d (#8179)
Signed-off-by: QianCyrus <101633534+QianCyrus@users.noreply.github.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-10-06 11:44:34 +08:00 |
|
|
SunandOpenAI Codex
|
3f20252151
|
[Model] Fuse MammothModa2 QK norm and RoPE (#7969)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-05 02:44:45 +08:00 |
|
|
quan-yi-aiandHongsheng Liu
|
65f5a1d5b3
|
[Bugfix][Examples][MammothModa2] Serve T2I via LLM-typed DiT stage (#7199) + benchmark harness and profiler wiring (#7293)
Signed-off-by: quan-yi-ai <82917002+quan-yi-ai@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-10-05 02:42:58 +08:00 |
|
|
Hongchen Liandredearly123
|
989161c49d
|
[Benchmark] Add MammothModa2 startup/loading breakdown (#7312)
Signed-off-by: redearly123 <65453204+redearly123@users.noreply.github.com>
Co-authored-by: redearly123 <65453204+redearly123@users.noreply.github.com>
|
2026-09-30 11:38:07 +08:00 |
|
|
|
35cf6ac355
|
[Feat][Perf][AuK]Support Online Serving and DiT CUDAGraph (#7469)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-30 00:18:38 +00:00 |
|
|
R0CKSTAR
|
29b818a785
|
feat(magi2): add fused BF16 routed MoE path (#7206)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-09-28 23:20:30 +08:00 |
|
|
Shenglei FuandClaude
|
eb67caaaa9
|
[Diffusion] Enable request-level batching for Boogu-Image (TI2I) (#7227)
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-09-26 22:53:35 +08:00 |
|
|
R0CKSTAR
|
e75278dccc
|
feat(magi2): add fused SwiGLU7 activation (#7252)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-09-26 22:53:04 +08:00 |
|
|
R0CKSTARandHongsheng Liu
|
3bf96080f3
|
feat(magi2): add fused mHC post-processing (#7261)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-25 16:25:12 +08:00 |
|
|
Yukim1
|
205aa01c7b
|
[Diffusion][HunyuanImage3] Add request paged prefix caching (#7719)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-09-23 15:34:56 +00:00 |
|
|
Yueqian Lin
|
3f473a358b
|
[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)
|
2026-09-22 17:10:15 -07:00 |
|
|
MaciejBalaNV
|
c482626450
|
[optimization] Added Wan 2.2 VAE decode optimizations (#7056)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
|
2026-09-22 11:37:49 -07:00 |
|
|
|
59db6a4285
|
[Rebase] Rebase to vLLM 0.30.0 (#7820)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-22 15:52:01 +00:00 |
|
|
Zhou TaichangandClaude Opus 5
|
856d19f42c
|
[Benchmark] Add LingBot-World realtime streaming benchmark (#7645)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-21 13:12:00 +00:00 |
|
|
AliciaandHongsheng Liu
|
d02681bf01
|
[Refactor][Diffusion] Move single-model layers into their model directories (#5908)
Signed-off-by: congw729 <115451386+congw729@users.noreply.github.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-20 18:19:24 +08:00 |
|
|
howard.shan
|
c61b30255b
|
[Qwen3-Omni] Remove redundant text embedding in DeepStack path (#7573)
Signed-off-by: howard-shan <shanwenhao668@gmail.com>
Signed-off-by: howard.shan <shanwenhao668@gmail.com>
|
2026-09-17 05:47:10 -07:00 |
|
|
hywandAlex Brooks
|
2a68471715
|
[Bugfix] Reject failed diffusion benchmark warmups (#7092)
Signed-off-by: hyw <yuweih205@gmail.com>
Signed-off-by: HuangYuwei <yuweih205@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
|
2026-09-16 17:09:23 +00:00 |
|
|
NumberWanandwangyu
|
81b5be274d
|
[Bugfix][Qwen-Image] Restore RotaryEmbedding CUDA RoPE for Diffusers e2e (#7513)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com>
|
2026-09-16 08:54:28 -07:00 |
|
|
Zhengyuan Su (苏政渊)
|
538eddd74d
|
[Perf][CosyVoice3] Bounded-window incremental HiFT vocoder streaming (#7521)
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
|
2026-09-16 20:49:04 +08:00 |
|
|
dongbo910220
|
217a6af52c
|
[Diffusion] Fuse Qwen-Image-Edit select01 modulation for CUDA (#5921)
Signed-off-by: dongbo910220 <1275604947@qq.com>
|
2026-09-16 19:06:28 +08:00 |
|
|
dongbo910220
|
952022c8ec
|
[Diffusion][Perf] Add Qwen-Image QK RoPE Triton path (#5931)
Signed-off-by: dongbo910220 <1275604947@qq.com>
|
2026-09-15 14:28:48 +00:00 |
|
|
Yash Jain
|
5f50fc3daf
|
[Kernel] Fuse Ming streaming ISTFT overlap-add and normalization (#7338)
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com>
|
2026-09-14 15:25:25 -07:00 |
|
|
nodeeeeee
|
909b121e0a
|
[Qwen2.5-Omni] Avoid redundant embedding computation (#7477)
Signed-off-by: nodeeeeee <zhangkai.nodeee@gmail.com>
|
2026-09-14 10:02:11 -07:00 |
|
|
Hongsheng Liu
|
f11bf1a05d
|
[Misc] Add standalone safetensors retention diagnostic (#7145)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-10 17:57:20 +08:00 |
|
|
NancyFyongandNancyFyong
|
e74fe3c6e8
|
[Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157)
Signed-off-by: NancyFyong <NancyFyong@users.noreply.github.com>
Co-authored-by: NancyFyong <NancyFyong@users.noreply.github.com>
|
2026-09-08 19:00:25 -07:00 |
|
|
Alicia
|
031612f250
|
[Bugfix] Fix video benchmark timeout and failure accounting (#7259)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-09-08 09:40:08 +00:00 |
|
|
Weiming LiaoandGao Han
|
1cd92553cf
|
[CI][Bugfix] Use the matching checkpoint for Qwen3-TTS VoiceDesign tests (#7054)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-06 04:27:21 +00:00 |
|
|
0z5aand0z5a
|
4927fd5412
|
[Core] Optimize diffusion LoRA expand accumulation (#6268)
Signed-off-by: 0z5a <0z5a@users.noreply.github.com>
Signed-off-by: 0z5a <dinadegttyarenko6@gmail.com>
Co-authored-by: 0z5a <0z5a@users.noreply.github.com>
|
2026-09-03 10:37:35 +08:00 |
|
|
DanaerLee
|
ca6b4e2112
|
[Perf][Bugfix][OmniVoice] Restore float16 serving, and fuse the generator hot loop (#6317)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
|
2026-09-02 19:54:55 +00:00 |
|
|
|
f90e992dc1
|
[Model] Optimize CosyVoice3 TensorRT stream handoff (#5673)
Signed-off-by: Allen Wu <allenwu2795@gmail.com>
Co-authored-by: TRAE CLI <noreply@bytedance.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: TRAE CLI <traecli@bytedance.com>
|
2026-08-25 22:51:46 -07:00 |
|
|
Yukim1
|
6f55a06fab
|
[Docs] Remove stale stage config references (#6270)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-08-20 07:09:12 +08:00 |
|
|
Hongsheng Liu
|
8b8d3f56db
|
[Misc] Consolidate LingBot text-to-video runner (#6076)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-13 08:42:37 +08:00 |
|
|
|
fcf1085395
|
[Refactor][OutputProcessor 2/8]: OmniRequestOutput should inherit RequestOutput and no nested wrap-up (#5146)
Signed-off-by: Boao Shi <aoibosh@connect.hku.hk>
Signed-off-by: bowieshi <aoibosh@connect.hku.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Shi Boao Bowie <aoibosh@connect.hku.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: ruirui(rein) yang <73573651+R2-Y@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-12 22:58:23 +08:00 |
|
|
Sy03andYueqian Lin
|
58007c0084
|
[New Model] Support IndexTTS 2.5 (#5957)
Signed-off-by: Sysy <1370724210@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-08-11 23:00:35 +00:00 |
|
|
WeiQing Chen
|
a874b8e09b
|
[Perf][CI] Add MiniMax-H3 4xH100 diffusion perf config (#5836)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-08-07 00:12:07 +08:00 |
|
|
wtz2333andhsliuustc0106
|
5a6a93dc5f
|
[diffusion][model] Add LingBot Video dense and MoE support (#5035)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
Signed-off-by: wtz2333 <2955110911@qq.com>
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-07-21 17:27:29 +08:00 |
|
|
bjf-frz
|
b14ff23041
|
[PERF][CI]Add Cosmos3 diffusion perf config (#5010)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-07-14 10:25:17 +00:00 |
|
|
faceless void
|
11f6a0b72e
|
Make speech streaming default to SSE (#4679)
Signed-off-by: syd520zy <529477025@qq.com>
|
2026-06-30 02:17:24 +00:00 |
|
|
Canlin Guo
|
2e6c83c89c
|
[Model] Support MOSS-TTS-local-v1.5 (#4664)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-06-25 15:43:03 +08:00 |
|
|
bjf-frz
|
2447740308
|
[Perf]perf: skip unused Cosmos3 I2V conditioning latents (#4614)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-06-22 09:51:47 +00:00 |
|
|
NATUREandAlicia
|
83e3b129f0
|
[Bugfix] Fix missing memory metrics info for bagel (ar->dit diffusion) (#4477)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-06-17 14:06:14 +08:00 |
|
|
|
46e0b71423
|
[Enhancement] Introduce High-Performance MoT (Mixture-of-Tokens) Kernels: Triton Implementation (#3960)
Signed-off-by: Yufeng Zhu <yzhu802@gatech.edu>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Co-authored-by: Yufeng Zhu <yzhu802@gatech.edu>
Co-authored-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-16 03:08:02 +00:00 |
|
|
|
e27fd46ab9
|
[Perf] Optimize Higgs Audio v3 serving (#4204)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-06-11 13:29:31 -07:00 |
|
|
Jianbao Huang
|
6cefe91370
|
[Perf] Enable fused RMSNorm for HunyuanImage3 (#3959)
|
2026-06-05 07:41:56 +00:00 |
|
|
Zhang JianandCanlin Guo
|
b550709bba
|
[TTS][Model] support MOSS-TTS series (#3420)
Signed-off-by: Zhang <jianmusings@gmail.com>
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Signed-off-by: jian <jianmusings@gmail.com>
Signed-off-by: Canlin Guo <961750412@qq.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-06-02 15:46:01 +08:00 |
|
|
+1
|
f92d84fcf9
|
[Rebase] Rebase to vllm releases/v0.22.0 (#3891)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: david6666666 <530634352@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: nainiu258 <cperfect02@163.com>
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com>
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com>
Co-authored-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com>
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-06-01 11:08:12 +08:00 |
|
|
ChenWenjingandGao Han
|
834abdaf8b
|
[ci][nightly] Voxcpm2 performance benchmark (#3864)
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-05-29 09:44:29 +08:00 |
|
|
|
126fb4b4a9
|
[Blackwell][1/N] Add SageAttention3 diffusion backend on blackwell(GB200/B200/RTX5090/PRO6000/DGX Spark available) (#3015)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-05-28 14:08:45 +00:00 |
|
|
|
373d3c7476
|
[Blackwell] Add CUDNN_ATTN and FLASHINFER_ATTN backends for diffusion (auto-route) (#3079)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Zhang <jianmusings@gmail.com>
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Co-authored-by: frauttauteffasu <247219357+frauttauteffasu@users.noreply.github.com>
Co-authored-by: Zhang Jian <jianmusings@gmail.com>
|
2026-05-28 11:09:25 +08:00 |
|
|
Dnoob
|
a3802d1e5c
|
[Doc][Benchmark] Rewrite benchmarks/README.md as repo-wide index (#1939)
Signed-off-by: root <Dnoob>
Signed-off-by: Dnoob <dxpouo@gmail.com>
|
2026-05-26 16:13:31 -10:00 |
|