TaffyOfficial and zuiho
66ec3a2aff
[Bugfix] Fix HunyuanImage3 MoE groups for vLLM 0.24 ( #4893 )
...
Signed-off-by: zuiho <2324465096@qq.com >
Co-authored-by: zuiho <2324465096@qq.com >
2026-07-05 15:37:42 +00:00
Vensen
ddba6de2ab
[Bugfix][sleep mode]: guard generation on partial wake and ensure wake idempotency ( #4834 )
...
Signed-off-by: vensen <vensenmu@gmail.com >
2026-07-05 14:50:08 +00:00
Yueqian Lin
d7b365df64
[Bugfix][Qwen3-TTS] Keep seeded residual MTP sampling batched ( #4889 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-07-05 21:47:06 +08:00
Zhou Taichang
86bdcaf3d5
[BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366 ) ( #4534 )
2026-07-05 07:17:58 +08:00
Sy03
aa21412c01
[Fix][VoxCPM2] Follow up unified graph config gate ( #4878 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-07-04 19:58:21 +00:00
Sy03 and Yueqian Lin
1b31f96240
[Bugfix] Fix Qwen3-TTS no-async-chunk payload splitting ( #4870 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-07-04 19:57:55 +00:00
Sy03 and Yueqian Lin
0798b0bf03
[Bugfix][Qwen3-TTS] Seed residual MTP sampling ( #4869 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-07-04 17:47:11 +00:00
boatman
29dcdec66d
[Cleanup]Replace legacy logging branches with PreparedRequest.model_type ( #4862 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-07-04 05:39:20 +00:00
Sy03 and Yueqian Lin
9eaca72382
[Perf][VoxCPM2] Add unified decode graph optimization ( #4606 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-04 05:30:48 +00:00
CAICAII
51c14eeaed
[BugFix] Preserve explicit deploy stage engine_extras ( #4255 )
...
Signed-off-by: CAICAIIs <3360776475@qq.com >
2026-07-04 04:16:21 +00:00
Haco
f7cdc45977
[BugFix] deploy schema stage runtime overrides for CLI diffusion flags no longer works ( #4101 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
2026-07-04 03:17:25 +00:00
Kotaro Kikuchi
46f10478dc
[Bugfix] Qwen-Image-Layered: allow layers=2 to match upstream demo ( #4777 )
...
Signed-off-by: Kotaro Kikuchi <ktrk115@gmail.com >
2026-07-04 03:06:24 +00:00
Canlin Guo
a8b2bf11d2
[Feature] Support MOSS-TTS-Local-v1.5 Streaming ( #4804 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-07-03 16:00:30 +08:00
Aleksi Vesanto and WeiQing Chen
0455bffc37
[ROCm][Perf] Add ROCm support for MXFP4 (w4a4) online quantization ( #4104 )
...
Signed-off-by: Aleksi Vesanto <avesanto@amd.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-07-03 13:17:32 +08:00
akshatvishu
04f400d36c
[Bugfix] Report stepwise Qwen-Image profiler metrics ( #4517 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-07-03 04:32:22 +00:00
wangyu
0b59dfb94a
[Bugfix] Fix pytest 9.1.0 duplicate parametrization in run_benchmark.py ( #4784 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-07-03 04:15:32 +00:00
akshatvishu
d9cf85d5e2
[BugFix] Use KV cache scale mapper in custom loaders ( #4810 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-07-03 04:11:28 +00:00
Mu GuanLin
3023bc40c2
[Feature][Refactor] LTX-2.3 I2V Support, Public Examples, and Shared Pipeline Refactor ( #4739 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-07-03 11:29:22 +08:00
CAICAII
b443504d61
[Diffusion] Add Diffusers quantization config bridge ( #3837 )
...
Signed-off-by: CAICAIIs <3360776475@qq.com >
2026-07-03 03:06:44 +00:00
Jiaqian Liu
f00caf35c4
[image][bugfix] Fix HunyuanImage3 bridge request batching ( #4849 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
2026-07-03 02:58:13 +00:00
Sean Gillen
431a7c71ac
[Model] Cosmos3: Skip unused action conditioning frames ( #4789 )
...
Signed-off-by: Sean Gillen <sgillen@nvidia.com >
2026-07-03 01:45:44 +00:00
Jun Hee Yoo and Claude Opus 4.8
9d8089095e
[Bugfix] Support append/extend/count actions in TrackingArgumentParser ( #4639 )
...
Signed-off-by: Junhee Yoo <junhee.yoo@navercorp.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-02 23:29:24 +00:00
Zeyu Huang | 黃澤宇 and Hongsheng Liu
1b0de21c55
[Chore]: refactor out unused/redundant params in diffusion pipelines ( #1235 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-02 16:32:05 +02:00
tzhouam and Claude Fable 5
35a423c9bd
[BugFix][CI] Address review follow-ups from v0.24.0 rebase ( #4709 )
...
Addresses Gaohan123's post-approval review comments on #4709 :
- pipeline_dreamzero: restore platform-dispatched synchronize() instead of
torch.cuda so DreamZero keeps working on non-CUDA hardware (regression
of #4399 introduced during the rebase).
- omni_scheduler_mixin: drop the VLLM_OMNI_INPUT_WAIT_TIMEOUT_S env-var
override; the full-payload input-wait timeout is now a plain constant.
- diffusion_worker: implement _DiffusionVllmModelConfig.is_diffusion by
mirroring upstream ModelConfig.is_diffusion (dLLM canvas_length check)
and document why omni DiT pipelines must not enable dLLM paths.
- qwen3_tts: make _embedding_dtype a class attribute on the talker and
prompt-embeds builder so __new__-based test stubs inherit it; remove
the (duplicated) manual assignments from the preprocess test.
- .buildkite: document why the rebase raised per-step timeouts (steps
were killed by the old limits, masking real failures; e.g. CustomVoice
passes in ~9-15 min but cold runs were killed at 20m).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-07-02 07:36:14 +00:00
Alex Brooks
5c51782c6b
[Bugfix] Realign Serving Tokenization Name to Fix Error Handling Routes ( #4816 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-07-02 15:23:35 +08:00
f11b32a42e
[Bugfix] Qwen3-TTS talker handles multi-token replay on resume ( #4559 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-02 04:46:05 +00:00
Jiaqian Liu
a25636d780
[NPU] Fix HunyuanImage3 MoE EP+SP parallel mapping ( #4344 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
2026-07-02 04:14:12 +00:00
NumberWan and Cursor
bbc0476237
[CI] Lower Qwen-Image e2e SSIM threshold from 0.97 to 0.94 ( #4613 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-07-02 02:22:10 +00:00
ChenWenjing
720bd756bf
[ci]loose voxcpm2 HNR baseline ( #4801 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-07-02 02:19:05 +00:00
4d2ee15156
[BugFix] Fix Code2Wav async_chunk streaming tail drop (boundary clicks + ~1.2% time compression) ( #4706 )
...
Signed-off-by: zhuxinlong <zhuxinlong959@gmail.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-02 09:13:42 +08:00
Thanaji Rao Thakkalapelli
1788d76eb3
[Feature] Improve diffusion LoRA compatibility for SDXL ( #4825 )
...
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com >
2026-07-01 23:41:16 +00:00
Alex Brooks and Didan Deng
d526dc93e8
[Fix]: Set .transformer on SenseNova pipeline, warn if no .transformer in CacheDiT summary ( #4326 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-07-01 17:40:07 +00:00
Renzheng Wang
6b11f6b41d
[Bugfix][Quant] Gate quack FP8 to datacenter Blackwell (sm_100.x) only ( #4817 )
...
Signed-off-by: wangrzneu <wangrzneu@gmail.com >
2026-07-01 16:51:17 +00:00
Zhou Taichang
a560ed184d
[Rebase] Rebase to vllm v0.24.0 ( #4709 )
2026-06-30 19:41:06 +08:00
SYLAR
bb8614595d
[BugFix][Cosmos3] Pad sound latents so video+sound runs under sequence parallelism ( #4678 )
...
Signed-off-by: lishunyang12 <125541396+lishunyang12@users.noreply.github.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
2026-06-30 17:23:36 +08:00
boatman
4028680b7e
[Perf]: Fused RMSNorm+3D Rope kernel in Sensenova-U1 ( #4669 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-06-30 16:32:47 +08:00
Yi Liu and Copilot
99234881f5
[Quant][AutoRound] Add W4A16 support for Qwen-Image ( #3588 )
...
Signed-off-by: yiliu30 <yi4.liu@intel.com >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
2026-06-30 16:27:28 +08:00
dd3a4d0a29
[Feat] Support CFG-Parallel For Sensenova-U1-8B-MoT ( #4188 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-06-30 08:03:26 +00:00
Jae
0899a1a666
Migrate audiox examples ( #4607 )
...
Signed-off-by: zzehli <jaeli_ottawa@outlook.com >
2026-06-30 04:41:30 +00:00
Mohammed Saif Abed and Claude
2fc00efa49
[Model] Migrate MammothModa2-Preview example to standard task example + model_extras ( #4691 )
...
Signed-off-by: mo saif <moisf56@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-06-30 04:34:06 +00:00
faceless void
11f6a0b72e
Make speech streaming default to SSE ( #4679 )
...
Signed-off-by: syd520zy <529477025@qq.com >
2026-06-30 02:17:24 +00:00
JiangJie Zhang and Samit
c45ac74d43
[Core][Frontend] Support request-level batching for diffusion pipelines ( #4079 )
...
Signed-off-by: jader <yjader@foxmail.com >
Co-authored-by: Samit <285365963@qq.com >
2026-06-29 18:09:19 +02:00
504698dec8
[Core] Performance fix for orchestrator bottleneck: separates inter-stage from client outputs ( #4527 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Chenguang ZHENG <645327136@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-29 17:43:36 +02:00
wangyu and Hongsheng Liu
7619ed6b82
[CI] Reducing mithril-h100-pool in ready&merge CI, optimize ready CI duration ( #4354 )
...
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: [Your Name] <[Your Email]>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-29 05:17:57 +00:00
Isaac Hung
e9d4931781
[Core] Remove dead custom_process_input_func hooks in stage input processors ( #4531 )
...
Signed-off-by: Isaac Hung <manhei5001@gmail.com >
2026-06-29 05:17:25 +02:00
bjf-frz and Alicia
cd35572069
[CI]Add Cosmos3 L2 serving tests ( #4535 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-06-29 09:15:17 +08:00
Chendi.Xue
60ccadfbb6
[WAN_S2V] Enable HSDP for wan s2v ( #4458 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
2026-06-28 06:27:58 +02:00
Yueqian Lin
92f7208559
[Bugfix] CosyVoice3: wrap ref_text in instruction template ( #4644 ) ( #4756 )
2026-06-27 14:38:33 -07:00
Yueqian Lin
05a86ed10e
[Test] Un-skip Qwen3-TTS batch E2E; match documented omit-null response shape ( #4757 ) ( #4759 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-26 23:31:44 -07:00
wangyu
c6ee3f7c18
[Test] Skip Qwen3-TTS batch E2E tests ( #4758 )
2026-06-27 10:45:40 +08:00