Hongsheng Liu
339761045f
[Core] Make post-load publication warm-only
...
Close publication leases inside Host Weight Runtime, return only the publication report, and cover the new terminal mappings. Rename the runtime test module to avoid the pytest basename collision reported in #6436 .
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-21 12:18:12 +08:00
Hongsheng Liu
4c773109b1
[Core] Add post-load host weight publication
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-21 09:05:34 +08:00
Hongsheng Liu
73b623f2f7
[Core] Add Host Weight Runtime foundation ( #6419 )
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-21 08:50:59 +08:00
Ian Eaves
5730af0a95
[Bugfix] Preserve prompt token usage details ( #5181 )
...
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com >
2026-08-20 20:05:05 +00:00
37c11e6e4f
[Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor ( #5791 )
...
Signed-off-by: sheenlin <sheenlin@tencent.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: sheenlin <sheenlin@tencent.com >
Co-authored-by: yurain <yurain26@users.noreply.github.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-08-20 19:22:40 +00:00
MaciejBalaNV and Roger Wang
13c2de684c
Cosmos3 logging and prompt improvements ( #6325 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-08-20 12:04:49 -07:00
MaciejBalaNV
b3270dec8d
Cosmos3 transfer fix ( #5614 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
2026-08-20 11:40:51 -07:00
Yash Jain
c6e38860e9
[Bugfix][Core] Fix replica device split when a stage omits devices ( #5445 )
...
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com >
2026-08-21 00:44:03 +08:00
zzh
b1da47b781
Fix npu moe registration ( #6350 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-08-20 16:34:24 +00:00
dengyunyang
8d34d3b5de
[Perf][Hunyuan] Optimize for vae and patch_embed ( #6306 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-08-20 16:29:21 +00:00
Inesh Reddy Chappidi
cd3867c373
[Model] Suppress silence codec tokens for the first N Qwen3-TTS decod… ( #5048 )
...
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com >
2026-08-20 09:22:37 -07:00
Kristoffer and Hongsheng Liu
718d9a4cd7
[Bugfix] Return diffusion metrics for image-edit endpoint ( #5999 )
...
Signed-off-by: Kristoffer <kristoffer.torp@amd.com >
Signed-off-by: kTorp <kristorp@amd.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-20 15:28:55 +00:00
wangyu
273ffce130
[CI/Build] Strengthen pre-commit with markdownlint, SPDX, and policy hooks ( #6273 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
2026-08-20 21:07:04 +08:00
Zhou Taichang and Claude Fable 5
10906e3a6d
[Refactor] Worker/ModelRunner runner correctness fixes (G2/N) ( #5452 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-20 16:47:50 +08:00
amy-why-3459
48e4f6a385
[Bugfix][MiniCPM-o][NPU] Skip Code2Wav dynamo unwrap when flow.encode… ( #6397 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-20 16:24:08 +08:00
WeiQing Chen
53df9fe62b
[Bugfix] Use dedicated WORLD group for distributed VAE communication ( #6401 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-08-20 16:13:34 +08:00
b57dc70ec4
[Bugfix] Reclaim resumable async-chunk requests on finish ( #6360 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Ruirui Yang | Rein <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-20 15:59:39 +08:00
R0CKSTAR
b58feb1420
[MUSA] Fix SwiGLU to use fused op ( #6364 )
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2026-08-20 14:19:14 +08:00
linzhenpl07 and Claude Opus 5
38cf9adc38
[BugFix][Diffusion] Fix MiniMax-H3 VAE hang when decoder tiles are fewer than ranks ( #6345 )
...
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-20 12:42:14 +08:00
amy-why-3459 and Cursor
9c61d5b67b
[Bugfix][MiniCPM-o] Stop Talker mid-utterance truncation and load cod… ( #6346 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-20 11:50:07 +08:00
Joshna-Medisetty and Cursor
bd17618c11
[XPU][Bugfix] Make Omni AR async output path device-agnostic ( #5569 )
...
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-19 20:06:33 -05:00
Yukim1
6f55a06fab
[Docs] Remove stale stage config references ( #6270 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
2026-08-20 07:09:12 +08:00
Thanaji Rao Thakkalapelli and Chendi.Xue
efaf4276f9
[Bugfix] Record device-agnostic torch.Event on XPU to fix async D2H image corruption [XPU] ( #5571 )
...
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com >
Co-authored-by: Chendi.Xue <chendi.xue@intel.com >
2026-08-19 16:30:38 -05:00
ea24deefcc
[Bugfix][FLUX.2-klein] Fix duplicated image position ids ( #6130 )
...
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com >
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Chendi.Xue <chendi.xue@intel.com >
2026-08-19 16:30:12 -05:00
BruceLoveDecimal
7099583404
[Bugfix][MiniCPM-o] Restore streaming audio cache and unstall the first duplex response ( #6274 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
2026-08-19 07:26:03 +00:00
Sy03
26e003715c
[Perf] Enable async schedule for MOSS-TTS ( #6241 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-08-19 06:36:19 +00:00
Yuanheng Zhao
a630b0c2ec
[Ming] Cleanup Ming-family shared modules ( #6119 )
...
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-08-19 14:13:40 +08:00
BruceLoveDecimal and 汪志鹏
adf6d0c1ea
[Model] Add SANA-WM support(Stage-1 only) ( #4061 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: liuqihao <liuqihao970610@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-08-18 23:57:55 -06:00
bjf-frz and Hongsheng Liu
14bd8f8772
[REFACT]Refactor diffusion parallel state ( #5531 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-19 11:23:10 +08:00
Canlin Guo
14f2c16fb2
[Perf] Fuse MiniMax H3 modulation with FP32 accumulation ( #6281 )
...
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
2026-08-18 20:13:54 -07:00
Canlin Guo
9683b7f4b4
[Perf] Fuse MiniMax H3 SwiGLU activation ( #6283 )
...
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
2026-08-18 20:12:10 -07:00
Doug Smith
07ceb3324a
[BugFix][TTS] Move user input from INFO to DEBUG in TTS/audio log lines ( #6329 )
2026-08-18 16:22:11 -06:00
Alex Brooks
b4b907e7b6
[Bugfix | Model] Fix SenseNova & Use Well-defined Model Configs ( #5877 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-08-18 16:43:05 +00:00
Weiming Liao
f208f907bc
[BugFix][NPU] Wan2.2-S2V RoPE: replace complex64 advanced indexing with index_select ( #6320 )
...
Signed-off-by: Weiming Liao <liaowm5@gmail.com >
2026-08-19 00:06:29 +08:00
Hongsheng Liu
284e05c88b
[Core] Support online FP8 with DLO AllGather ( #6279 )
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-18 23:48:07 +08:00
Hongsheng Liu
c3de04e127
[Bugfix] Avoid eager pi0 runtime import in pipeline registry ( #6322 )
...
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-18 23:42:03 +08:00
4cd667875f
[XPU][SDXL] Fix text encoder input device under CPU offload ( #6125 )
...
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
2026-08-18 14:03:31 +00:00
Wang fuyin and Hongsheng Liu
e1c5f59aab
[Config] Reuse vLLM configs in VllmOmniConfig ( #6050 )
...
Signed-off-by: Acerak01-fy <wfy2003324@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-18 21:27:58 +08:00
TJian
02069a5bbf
[ROCm] [CI] Fix circular import for rocm due to patch ( #6287 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-08-18 09:45:05 +00:00
Yukim1 and zwhzzz0821
0a1846aa45
[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation ( #6094 )
...
Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com >
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com >
2026-08-18 07:00:24 +00:00
Yueqian Lin
b283215c28
[Model] Add MiniMax Music 3 text-to-music ( #6186 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-08-18 04:33:13 +00:00
psv666 and amy-why-3459
199ef7779c
[Bugfix][MiniCPM-o] Load Daily-Omni QA metadata from the hub cache ( #6276 )
...
Signed-off-by: psv666 <2693925048@qq.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-18 10:53:55 +08:00
amy-why-3459
3c6648d8a5
[Bugfix][NPU] Break the pytest DiffusionOutput circular import ( #6293 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-18 10:11:10 +08:00
JackyLiu and Hongsheng Liu
d7216ef514
Add speech token usage headers ( #4499 )
...
Signed-off-by: JackyLiu <lzwgre@126.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-18 06:53:06 +08:00
Zhou248
5d09cf27a9
[MiniCPM-o][NPU] Enable MiniCPM-o Code2Wav NPUGraph replay ( #5604 )
...
Signed-off-by: Zhou248 <62542847+Zhou248@users.noreply.github.com >
2026-08-17 15:09:51 +08:00
TJian
170d498771
[ROCm] [CI] Fix cpu test on rocm ( #6267 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-08-17 14:46:30 +08:00
Yichen Wang and Didan Deng
2a9f6aaa8e
Add π0 VLA model support ( #4222 )
...
Signed-off-by: Yichen Wang <yichen.wang@bytedance.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-08-17 14:29:17 +08:00
Zhenghan Song and Hongsheng Liu
309d9c3ea8
[Bugfix] Respect media redirect policy for image references ( #6122 )
...
Signed-off-by: HaningZS <resossr0v0@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-17 13:25:09 +08:00
boatman
65b3d41b3a
[Migrate] Move sampling parameter overrides from legacy dispatches to TTS adapters ( #5272 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-08-16 21:14:26 -07:00
Yueqian Lin and Hongsheng Liu
611c083587
[BugFix][TTS] R1.1-R1.4: turn silent async-chunk failures into visible ones ( #6033 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-17 10:51:17 +08:00