tzhouam and Claude Opus 5
c1e32fc01d
rebase: close the remaining vLLM 0.29 drift found by CI 3009
...
Five further removals/renames, each traced from a failing 3009 job:
- StageEngineCoreProcManager mirrors the parent __init__ rather than calling
super(), and 0.29 added _request_shutdown_timeout there. The inherited
shutdown() read it, raised AttributeError, and left the engine core
subprocesses running, so the test process hung at interpreter exit until
the 15 minute job timeout. That is the whole of the Engine&Model Executor
exit-124: its pytest reported 567 passed, then sat idle for 663s. The
failure surfaced only as a StagePool warning, never as a test failure.
- PromptUpdateDetails.select_text is gone; prompt updates are token oriented
now. MiniCPM-o 4.5 kept three text-based image/video/audio replacements,
which crashed stage-0 startup and account for the whole MiniCPM-o cluster.
They encode the text and select the unk placeholder by token id instead.
- Qwen3-Omni: 0.29 marks audio_feature_lengths keep_on_cpu, while the audio
tower derives device placement from feature_lens, so the mask comparison
mixed cuda and cpu tensors. Moved explicitly, matching upstream
Qwen3OmniMoeThinker._process_audio_input.
- AttentionBackend.get_kv_cache_shape is gone; the per-layer shape comes from
the spec via compute_layer_kv_cache_shape_bytes, whose content dim is in
bytes.
- WeightsMapper.get_unstacked_mapper is renamed to get_rename_mapper.
tests/engine/test_async_omni_engine_abort.py::test_abort fails here both with
and without these changes, so it is environmental rather than a regression.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_0146Xu5Sgj4vXxLxvLjV5YPj
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
87a1fd8da2
rebase: adapt to vLLM v0.29 APIs
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:52 +08:00
eval
d7678e2bb3
[Bugfix][MiniCPM-o] Fix the audio_embeds input path ( #5730 )
...
Signed-off-by: eval-dev <0xe5bca0@gmail.com >
Signed-off-by: eval <74645252+eval-dev@users.noreply.github.com >
2026-09-08 18:41:42 -07:00
fdaf4e31bd
Add vLLM-Omni library info to Hugging Face Hub requests ( #5381 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-08 10:08:38 -06:00
cf36f5e474
[Bugfix][MiniCPM-o] Allow ragged audio_feature_lens across a batch ( #7071 )
...
Signed-off-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com >
Co-authored-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-09-07 23:51:13 +08:00
NATURE and amy-why-3459
ff6e906a25
[Model] Preserve MiniCPM-o Talker full attention until capacity ( #6799 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-09-06 22:25:35 +08:00
5d7fdf9350
[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental ( #6196 )
...
Signed-off-by: chickeyton <ngton2014@gmail.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-09-05 08:20:21 +00:00
Inesh Reddy Chappidi and Gao Han
66d938100b
[Bugfix] Give exact-shape codec models an unpadded input_ids view ( #6775 )
...
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com >
Signed-off-by: IneshReddy249 <ineshreddy249@gmail.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-09-04 15:28:49 -07:00
akshatvishu
f321cdbe16
[Bugfix] Use Seed-TTS reference audio with MiniCPM-o 4.5 ( #6628 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-31 10:27:34 +08:00
NATURE
87736a3cc5
[Bugfix][MiniCPM-o] Bound full-duplex Talker context with sliding recompute ( #6626 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-30 00:49:42 +08:00
BruceLoveDecimal and amy-why-3459
ab8d45d3cc
[Bugfix][MiniCPM-o] Retire CFM DiT CUDA graphs a generation at a time ( #6587 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-28 14:07:57 +08:00
wy17003 and Hongsheng Liu
b454e34966
[Refactor][2/N Scheduler]Replace _FULL_PAYLOAD_INPUT_STAGES with a resolved stage transport capability. ( #6149 )
...
Signed-off-by: wy17003 <yaow17003@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-25 15:24:59 +08:00
NATURE
702a409664
[Feature][MiniCPM-o] Support configurable concurrent duplex sessions ( #6021 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-25 02:27:30 +00:00
amy-why-3459
42059f19d5
[Bugfix][MiniCPM-o] Cap offline Talker generation at remaining context ( #6458 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-22 12:42:49 +08:00
NATURE and amy-why-3459
4f7c08c0eb
[Bugfix][MiniCPM-o] Fix async-chunk snapshot replacement and prompt cleanup ( #6406 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-21 16:37:21 +08:00
amy-why-3459
48e4f6a385
[Bugfix][MiniCPM-o][NPU] Skip Code2Wav dynamo unwrap when flow.encode… ( #6397 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-20 16:24:08 +08:00
amy-why-3459 and Cursor
9c61d5b67b
[Bugfix][MiniCPM-o] Stop Talker mid-utterance truncation and load cod… ( #6346 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-20 11:50:07 +08:00
BruceLoveDecimal
7099583404
[Bugfix][MiniCPM-o] Restore streaming audio cache and unstall the first duplex response ( #6274 )
...
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com >
2026-08-19 07:26:03 +00:00
liwener and amy-why-3459
877beeaa49
[Perf][MiniCPM-O-4.5]Add CUDA Graph For CFM DiT estimator ( #6082 )
...
Signed-off-by: liwener <liwener.c@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-13 09:36:17 +08:00
Zhou248
f97af75d1d
[Model] Batch MiniCPM-o Talker codec sampling ( #5792 )
...
Signed-off-by: Zhou248 <62542847+Zhou248@users.noreply.github.com >
2026-08-11 14:05:02 +08:00
boatman
fc8946fcf5
[Perf][MiniCPM-O-4.5]Add CUDA Graph For HiFTGenerator ( #5869 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-08-09 22:29:49 +08:00
6ec9033065
[Model] MiniCPM-o 4.5: reuse FlashAttention unpadding metadata ( #5165 )
...
Signed-off-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-07 10:25:04 +08:00
hesiru and amy-why-3459
9235b0ae65
Optimize MiniCPM-o 4.5 Whisper chunk-attention mask construction ( #5382 )
...
Signed-off-by: a-kaa <siruhe666@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-06 09:48:46 +08:00
f201b7171f
[Perf][MiniCPM-o] TensorRT acceleration for the Code2Wav vocoder (DiT estimator + campplus) ( #5638 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-04 20:58:19 -07:00
amy-why-3459 and Cursor
67aa6c55a4
[Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… ( #5625 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-07-31 22:41:00 -07:00
NATURE
0a03359224
[Bugfix][MiniCPM-o] Stabilize single-GPU audio generation ( #5637 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-01 03:01:06 +00:00
Sy03 and Hongsheng Liu
0feb92bdfa
[Bugfix][Minicpm] Support full-duplex three-stage serving ( #5380 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-29 01:58:34 +08:00
Yueqian Lin
8f115164c2
[Bugfix][Connectors] Flush processor tail on terminal async-chunk sends ( #5414 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-27 16:04:08 +00:00
cbab1d4d8f
[Rebase] Rebase to vllm 0.26.0 ( #5443 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@gmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: tzhouam <tzhouam@gmail.com >
2026-07-27 23:35:49 +08:00
ruirui(rein) yang and amy-why-3459
82172b112d
[BugFix][MiniCPM-o] Restore audio output without async chunk ( #5455 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-27 22:19:46 +08:00
xsmccc and xsmccc
d688aa82fc
[Model] Optimize MiniCPM-o multimodal encoder memory ( #5188 )
...
Signed-off-by: xsmccc <247721718+xsmccc@users.noreply.github.com >
Co-authored-by: xsmccc <247721718+xsmccc@users.noreply.github.com >
2026-07-27 15:24:51 +08:00
b6c4578dac
[BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) ( #5237 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-25 17:00:13 -07:00
rein yang and Sy03
ad3a162eb8
[perf] Minicpm o4.5 optimization ( #5228 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Sy03 <1370724210@qq.com >
2026-07-24 17:20:39 +08:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
psv666
b55120c93b
[Model][MiniCPM-o 4.5] Resolve Hugging Face model ID to local cache path in TTS ( #5301 )
...
Signed-off-by: psv666 <2693925048@qq.com >
2026-07-23 16:05:54 +08:00
68ee52f4e7
[Model] MiniCPM-o 4.5: optimize SigLIP position IDs ( #5130 )
...
Signed-off-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-22 18:35:37 +08:00
ea34bde619
[Bugfix] MiniCPMo-4.5 bugfix ( #5233 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Guanzhe (Leo) Huang <116847811+leohuang257@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-22 09:23:03 +08:00
Hongshaorou and amy-why-3459
0576264dd1
[Bugfix] Fix MiniCPM-o 4.5 audio placeholder pool step ( #5116 )
...
Signed-off-by: a-kaa <siruhe666@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-21 15:44:05 +08:00
fatSheep and amy-why-3459
5d44868e91
[Hardware][Ascend] Keep HiFT vocoder on NPU ( #5242 )
...
Signed-off-by: fatSheep <tzh2005t@163.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-21 14:30:30 +08:00
amy-why-3459
74f2742ac2
[Hardware][Ascend][Model] Add NPU support for MiniCPM-o 4.5 talker/vo… ( #5117 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-20 21:45:28 +08:00
Yukim1 and Hongsheng Liu
793d3e9ab7
[Config] Return VllmOmniConfig from create_from_model ( #4818 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-18 09:21:07 +00:00
Alex Brooks
465f1464d2
[Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager ( #3760 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-24 11:02:29 +08:00
Nick Cao
67d14b5ac4
[Refactor] Replace hardcoded CUDA device selection with platform-agnostic API ( #4496 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-06-23 14:38:32 +08:00
Zhou Taichang
7b837944a1
[Rebase] Rebase to vllm 0.23.0 ( #4286 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-06-13 16:43:02 +00:00
2b7249fbb3
[Model]Support MiniCPM-o 4.5 ( #3642 )
...
Signed-off-by: tc-mb <tianchi_cai@icloud.com >
Co-authored-by: GKangaroo <1095103651@qq.com >
Co-authored-by: GKangaroo <gqx24@mails.tsinghua.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-01 22:12:24 +08:00