tzhouam and Claude Opus 5
94914a1270
rebase: keep the omni scheduler on the v1 model runner
...
Every omni worker already forces the v1 model runner because the v2 runner
carries no omni hooks (four worker classes do this). The scheduler was left
reading the config value, and vLLM 0.29 changed that default: 0.28 resolved
this config to v1, 0.29 ends its new fallback chain with v2.
The two then disagreed. The scheduler took its v2 fast path, which
deliberately omits resumed-request token ids ("No resumed reqs in fast
path"), while the worker-side v1 runner still read them, so resuming a
request raised KeyError: <req_id> in _update_states and killed the engine
core. That is the Multi-Replica Startup Test failure: it passes on main
6/6 and on the branch before the rebase (3005), and fails on every build
since.
Forcing it once in OmniSchedulerMixin covers both OmniARScheduler and
OmniGenerationScheduler, mirroring the wording the workers already use.
Adds tests/core/sched/test_omni_scheduler_forces_v1_model_runner.py, since a
default-sensitive regression like this would otherwise return silently: it
pins Omni's side of the contract rather than the upstream default, and was
negative-controlled by removing the fix (2 of 3 cases fail without it).
The 4x H100 multi-replica path itself is not reproducible here, so that part
is verified only by proxy: 165 sched tests, plus a 599-test
core/diffusion/ar_diffusion sweep, and the change is inert whenever the
config already resolves to v1.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_0146Xu5Sgj4vXxLxvLjV5YPj
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
NATURE and amy-why-3459
ff6e906a25
[Model] Preserve MiniCPM-o Talker full attention until capacity ( #6799 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-09-06 22:25:35 +08:00
21dd4b33ac
[Bugfix][MiniCPM-o] Stabilize native duplex streaming and Stage-1 handoffs ( #6529 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Nathan Price <nathan@abridge.com >
Co-authored-by: Eric(Qun) <186020953+0xtoward@users.noreply.github.com >
2026-08-29 13:05:24 -07:00
NATURE
87736a3cc5
[Bugfix][MiniCPM-o] Bound full-duplex Talker context with sliding recompute ( #6626 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-30 00:49:42 +08:00
NATURE
54c1fc64b7
[Bugfix] Gate async-chunk segment resume by session mode ( #6680 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-27 18:52:09 +08:00
Zhou Taichang and Claude Opus 5
651b03225b
[Rebase] Rebase to vllm 0.28.0 ( #6606 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-27 06:12:55 +00:00
Sy03 and sy03
432b2c6ca3
[Model] Add native full-duplex Nemotron VoiceChat serving ( #6089 )
...
Signed-off-by: Sysy <1370724210@qq.com >
Signed-off-by: sy03 <137072421@qq.com >
Co-authored-by: sy03 <137072421@qq.com >
2026-08-26 13:19:20 -07:00
amy-why-3459
5de6f7c37a
[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… ( #6619 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-26 10:56:51 +08:00
7ae15c74c8
text and image metric ( #6150 )
...
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-08-26 02:54:45 +00:00
wy17003 and Hongsheng Liu
b454e34966
[Refactor][2/N Scheduler]Replace _FULL_PAYLOAD_INPUT_STAGES with a resolved stage transport capability. ( #6149 )
...
Signed-off-by: wy17003 <yaow17003@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-25 15:24:59 +08:00
NATURE
702a409664
[Feature][MiniCPM-o] Support configurable concurrent duplex sessions ( #6021 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-08-25 02:27:30 +00:00
NATURE and amy-why-3459
4f7c08c0eb
[Bugfix][MiniCPM-o] Fix async-chunk snapshot replacement and prompt cleanup ( #6406 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-21 16:37:21 +08:00
b57dc70ec4
[Bugfix] Reclaim resumable async-chunk requests on finish ( #6360 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Ruirui Yang | Rein <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-20 15:59:39 +08:00
Yueqian Lin and Hongsheng Liu
611c083587
[BugFix][TTS] R1.1-R1.4: turn silent async-chunk failures into visible ones ( #6033 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-17 10:51:17 +08:00
Yuekai Zhang and Claude Fable 5
5be7541d01
[Model] Support NVIDIA-NemotronLabs-VoiceChat-11B offline speech-to-speech ( #5842 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-12 16:25:48 +08:00
9b0df3909a
[Feature] timestamps for TTS via a forced-aligner pooling ( #4795 )
...
Signed-off-by: wjinxu <1299461899@qq.com >
Co-authored-by: xurui <xurui1@modelbest.onaliyun.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-08-12 05:33:34 +00:00
Sy03 and Yueqian Lin
58007c0084
[New Model] Support IndexTTS 2.5 ( #5957 )
...
Signed-off-by: Sysy <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-11 23:00:35 +00:00
Zhou Taichang and Claude Opus 5
2ce15ab7a0
[Rebase] Rebase to vllm 0.27.0 ( #5976 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-11 15:23:46 +00:00
Yueqian Lin and Sy0307
e788ef6e76
[Feature] PersonaPlex (Moshi-based full-duplex S2S): native vLLM port + duplex serving ( #4771 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Sy0307 <24841857+Sy0307@users.noreply.github.com >
Co-authored-by: Sy0307 <24841857+Sy0307@users.noreply.github.com >
2026-08-04 20:10:33 -07:00
ruirui(rein) yang
5215e03a91
[Refactor][1/N Scheduler]Remove duplicated AR/generation scheduler plumbing and establish explicit shared lifecycle contracts. ( #5461 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
2026-08-04 15:10:47 +08:00
SYLAR and lishunyang12
6f98c807d2
[Bugfix] Restore BAGEL CFG KV transfers ( #5620 )
...
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
2026-08-01 15:06:05 +00:00
akshatvishu
cd5daaea6a
[BugFix][Metrics] Fix per-stage time and token stats in metrics API ( #4974 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-01 03:54:17 +00:00
Shenglei Fu and Claude
3b0718f22e
[Bugfix] Fix active_stream_window silently stalling audio generation ( #5349 ) ( #5373 )
...
Signed-off-by: Shenglei Fu <sfu@confluent.io >
Co-authored-by: Claude <noreply@anthropic.com >
2026-07-30 14:56:18 +00:00
Yash Jain and Claude Fable 5
daec3a6a49
[Bugfix] Trim AR sampled logprob rows with new_token_ids on mid-step stop ( #5564 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-30 03:00:53 +00:00
Sy03 and Hongsheng Liu
0feb92bdfa
[Bugfix][Minicpm] Support full-duplex three-stage serving ( #5380 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-29 01:58:34 +08:00
Canlin Guo
61324e65d7
[Refactor] Make MOSS-TTS-Local stream session dynamic batch ( #5235 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
2026-07-28 21:38:24 +08:00
5014fea4a0
[New Model] support nemotron Audex ( #4976 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-28 03:58:22 +00:00
Wei and Samit
d3e0171cd7
[bugfix] validate AR sampled-token logprob alignment ( #5273 )
...
Signed-off-by: hbhflw2000 <417911774@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-07-28 10:34:19 +08:00
cbab1d4d8f
[Rebase] Rebase to vllm 0.26.0 ( #5443 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@gmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: tzhouam <tzhouam@gmail.com >
2026-07-27 23:35:49 +08:00
ruirui(rein) yang and amy-why-3459
82172b112d
[BugFix][MiniCPM-o] Restore audio output without async chunk ( #5455 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-27 22:19:46 +08:00
b6c4578dac
[BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) ( #5237 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-25 17:00:13 -07:00
Sy03
e043818abf
[Bugfix][Frontend] Remove async-chunk guard from realtime API ( #5383 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-07-25 09:20:47 +08:00
Viacheslav Klimkov
784c27f493
[Bugfix][Core] Fix async streaming segment-stop accounting ( #5183 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
2026-07-24 19:31:47 +08:00
rein yang and Sy03
ad3a162eb8
[perf] Minicpm o4.5 optimization ( #5228 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Sy03 <1370724210@qq.com >
2026-07-24 17:20:39 +08:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
rein yang
1984346bc7
[Refactor] [0/N] Scheduler clean dead code ( #5312 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
2026-07-22 17:59:44 +08:00
Zhou Taichang and Claude Opus 4.8
d3c47efc4f
[Rebase] Rebase to vllm v0.25.0 ( #5042 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-12 23:39:53 +08:00
Sy03 and Yueqian Lin
9eaca72382
[Perf][VoxCPM2] Add unified decode graph optimization ( #4606 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-04 05:30:48 +00:00
Zhou Taichang
a560ed184d
[Rebase] Rebase to vllm v0.24.0 ( #4709 )
2026-06-30 19:41:06 +08:00
504698dec8
[Core] Performance fix for orchestrator bottleneck: separates inter-stage from client outputs ( #4527 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Chenguang ZHENG <645327136@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-29 17:43:36 +02:00
BeatSeat
044240d8eb
[Model] Add IndexTTS2 text-to-speech support ( #3838 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
Signed-off-by: David <david@podcast.ai >
Signed-off-by: wendavid552 <wendavid552@gmail.com >
Signed-off-by: WenDavid <davidzhangcf@foxmail.com >
2026-06-22 19:24:01 +00:00
LHXuuu and Hongsheng Liu
dff757da9c
[Perf][PrefixCache] Avoid per-step blocking write in OmniTensorPrefix… ( #4106 )
...
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-17 16:53:47 +08:00
Zhou Taichang
7b837944a1
[Rebase] Rebase to vllm 0.23.0 ( #4286 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-06-13 16:43:02 +00:00
8f869c8ea5
[Refactor] Output Processor Phase 2: separate multimodal output channel ( #1601 ) ( #2744 )
...
Signed-off-by: Megha Agarwal <agarwalmegha1308@gmail.com >
Signed-off-by: meghaagr13 <divyanshsinghvi@gmail.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: meghaagr13 <divyanshsinghvi@gmail.com >
Co-authored-by: Boao Shi <aoibosh@connect.hku.hk >
Co-authored-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-12 15:19:14 +08:00
Juan Pablo Zuluaga and JuanPZuluaga
0342827dd7
[Bugfix] qwen3-tts prefix cache: drop per-key size cap that corrupted… ( #4317 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
2026-06-10 21:20:08 +08:00
longguo and npuichigo
73df8326d7
[Bugfix] purge chunk-transfer zombies on every schedule tick to keep engine-core alive on aborts ( fixes #3736 ) ( #3774 )
...
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com >
Co-authored-by: npuichigo <11533479+npuichigo@users.noreply.github.com >
2026-06-10 09:00:23 +08:00
57227dc7f3
[Perf][Bugfix] qwen3-tts hot path: prefix-cache OOM guards + talker/orchestrator micro-opts ( #3689 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-09 10:36:57 -07:00
Yueqian Lin
82cce633a3
[Perf][Higgs-Audio-V3] Turn on Stage-0 prefix caching by default ( #4199 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-07 03:09:47 +00:00
ChenWenjing
e25239c2ec
[bugfix] fix realtime ci timeout error ( #4187 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-06-06 00:05:07 +08:00
ChenWenjing
3842970a82
[bugfix] fix streaming input issue after rebase 0.22.0 ( #4085 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-06-03 16:07:41 +08:00