tzhouam
efda9369a8
refactor: reduce copied vLLM 0.29 compatibility code
...
Reuse upstream weight mapping and multimodal processing, consolidate Omni processor bridges, and trim unused Hunyuan internals. Route no-media kwargs through the active renderer and preserve GLM generation prompt formatting.
Validation: 453 CPU tests passed, 7 skipped; processor imports, Ruff, and diff checks passed. GPU and end-to-end CI not rerun.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
87a1fd8da2
rebase: adapt to vLLM v0.29 APIs
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:52 +08:00
eval
d7678e2bb3
[Bugfix][MiniCPM-o] Fix the audio_embeds input path ( #5730 )
...
Signed-off-by: eval-dev <0xe5bca0@gmail.com >
Signed-off-by: eval <74645252+eval-dev@users.noreply.github.com >
2026-09-08 18:41:42 -07:00
fdaf4e31bd
Add vLLM-Omni library info to Hugging Face Hub requests ( #5381 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-08 10:08:38 -06:00
cf36f5e474
[Bugfix][MiniCPM-o] Allow ragged audio_feature_lens across a batch ( #7071 )
...
Signed-off-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com >
Co-authored-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-09-07 23:51:13 +08:00
NATURE and amy-why-3459
ff6e906a25
[Model] Preserve MiniCPM-o Talker full attention until capacity ( #6799 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-09-06 22:25:35 +08:00
5d7fdf9350
[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental ( #6196 )
...
Signed-off-by: chickeyton <ngton2014@gmail.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-09-05 08:20:21 +00:00
Alex Brooks
a65e89cbd4
[Core] Validate PipelineConfig in __post_init__ ( #6829 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-09-01 11:17:57 +08:00
akshatvishu
f321cdbe16
[Bugfix] Use Seed-TTS reference audio with MiniCPM-o 4.5 ( #6628 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-31 10:27:34 +08:00
NATURE
87736a3cc5
[Bugfix][MiniCPM-o] Bound full-duplex Talker context with sliding recompute ( #6626 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-30 00:49:42 +08:00
ZacheryAU and amy-why-3459
457c6e2793
[bugfix][MiniCPM-o] Re-land empty full-payload and async_chunk=false processor tests ( #6745 )
...
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-29 13:39:54 +08:00
Gao Han
6b9ce05feb
Revert "[bugfix][MiniCPM-o] Fix offline_inference/test_minicpmo_4_5.py and online_serving/ one" ( #6730 )
2026-08-29 08:14:02 +08:00
ZacheryAU and amy-why-3459
6d84409a68
[bugfix][MiniCPM-o] Fix offline_inference/test_minicpmo_4_5.py and online_serving/ one ( #5464 )
...
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-28 19:20:09 +00:00
BruceLoveDecimal and amy-why-3459
ab8d45d3cc
[Bugfix][MiniCPM-o] Retire CFM DiT CUDA graphs a generation at a time ( #6587 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-28 14:07:57 +08:00
NATURE
702a409664
[Feature][MiniCPM-o] Support configurable concurrent duplex sessions ( #6021 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-25 02:27:30 +00:00
amy-why-3459
42059f19d5
[Bugfix][MiniCPM-o] Cap offline Talker generation at remaining context ( #6458 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-22 12:42:49 +08:00
NATURE and amy-why-3459
4f7c08c0eb
[Bugfix][MiniCPM-o] Fix async-chunk snapshot replacement and prompt cleanup ( #6406 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-21 16:37:21 +08:00
amy-why-3459 and Cursor
9c61d5b67b
[Bugfix][MiniCPM-o] Stop Talker mid-utterance truncation and load cod… ( #6346 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-20 11:50:07 +08:00
BruceLoveDecimal
7099583404
[Bugfix][MiniCPM-o] Restore streaming audio cache and unstall the first duplex response ( #6274 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
2026-08-19 07:26:03 +00:00
Zhou248
5d09cf27a9
[MiniCPM-o][NPU] Enable MiniCPM-o Code2Wav NPUGraph replay ( #5604 )
...
Signed-off-by: Zhou248 <62542847+Zhou248@users.noreply.github.com >
2026-08-17 15:09:51 +08:00
liwener and amy-why-3459
877beeaa49
[Perf][MiniCPM-O-4.5]Add CUDA Graph For CFM DiT estimator ( #6082 )
...
Signed-off-by: liwener <liwener.c@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-13 09:36:17 +08:00
322600bfb2
[CI][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance coverage ( #5524 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: psv666 <2693925048@qq.com >
Co-authored-by: psv666 <2693925048@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-11 14:53:49 +08:00
Zhou248
f97af75d1d
[Model] Batch MiniCPM-o Talker codec sampling ( #5792 )
...
Signed-off-by: Zhou248 <62542847+Zhou248@users.noreply.github.com >
2026-08-11 14:05:02 +08:00
boatman
fc8946fcf5
[Perf][MiniCPM-O-4.5]Add CUDA Graph For HiFTGenerator ( #5869 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-08-09 22:29:49 +08:00
6ec9033065
[Model] MiniCPM-o 4.5: reuse FlashAttention unpadding metadata ( #5165 )
...
Signed-off-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-07 10:25:04 +08:00
hesiru and amy-why-3459
9235b0ae65
Optimize MiniCPM-o 4.5 Whisper chunk-attention mask construction ( #5382 )
...
Signed-off-by: a-kaa <siruhe666@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-06 09:48:46 +08:00
amy-why-3459 and Cursor
67aa6c55a4
[Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… ( #5625 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-07-31 22:41:00 -07:00
0a51a18570
[Bugfix] Leave MiniCPM-o vocoder memory headroom ( #5621 )
...
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-07-31 03:35:13 +00:00
aa5364f705
[refactor][MiniCPM-o] Consolidate MiniCPM-o 4.5 2-GPU deploy configs and E2E tests ( #5458 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-07-30 09:56:19 +08:00
Sy03 and Hongsheng Liu
0feb92bdfa
[Bugfix][Minicpm] Support full-duplex three-stage serving ( #5380 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-29 01:58:34 +08:00
Yueqian Lin
8f115164c2
[Bugfix][Connectors] Flush processor tail on terminal async-chunk sends ( #5414 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-27 16:04:08 +00:00
ruirui(rein) yang and amy-why-3459
82172b112d
[BugFix][MiniCPM-o] Restore audio output without async chunk ( #5455 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-27 22:19:46 +08:00
rein yang
5b230541c9
[Deploy] Reduce MiniCPM-o single-GPU startup memory ( #5447 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
2026-07-27 16:37:25 +08:00
xsmccc and xsmccc
d688aa82fc
[Model] Optimize MiniCPM-o multimodal encoder memory ( #5188 )
...
Signed-off-by: xsmccc <247721718+xsmccc@users.noreply.github.com >
Co-authored-by: xsmccc <247721718+xsmccc@users.noreply.github.com >
2026-07-27 15:24:51 +08:00
b6c4578dac
[BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) ( #5237 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-25 17:00:13 -07:00
rein yang and Sy03
ad3a162eb8
[perf] Minicpm o4.5 optimization ( #5228 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Sy03 <1370724210@qq.com >
2026-07-24 17:20:39 +08:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
psv666
b55120c93b
[Model][MiniCPM-o 4.5] Resolve Hugging Face model ID to local cache path in TTS ( #5301 )
...
Signed-off-by: psv666 <2693925048@qq.com >
2026-07-23 16:05:54 +08:00
68ee52f4e7
[Model] MiniCPM-o 4.5: optimize SigLIP position IDs ( #5130 )
...
Signed-off-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-22 18:35:37 +08:00
ea34bde619
[Bugfix] MiniCPMo-4.5 bugfix ( #5233 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Guanzhe (Leo) Huang <116847811+leohuang257@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-22 09:23:03 +08:00
Hongshaorou and amy-why-3459
0576264dd1
[Bugfix] Fix MiniCPM-o 4.5 audio placeholder pool step ( #5116 )
...
Signed-off-by: a-kaa <siruhe666@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-21 15:44:05 +08:00
Alex Brooks
465f1464d2
[Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager ( #3760 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-24 11:02:29 +08:00
2b7249fbb3
[Model]Support MiniCPM-o 4.5 ( #3642 )
...
Signed-off-by: tc-mb <tianchi_cai@icloud.com >
Co-authored-by: GKangaroo <1095103651@qq.com >
Co-authored-by: GKangaroo <gqx24@mails.tsinghua.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-01 22:12:24 +08:00
tzhouam