Taichang Zhou and Claude Opus 4.8
9678ae58cf
[MR V2] Migrate to Model Runner V2
...
Squashed migration rebased onto current main. Collapses the 46-commit
dev/migrate-MR-v2 history (10 merge commits + superseded pre-rebase work)
into a single commit, so the diff reflects only the genuine MR-V2 feature
(worker_v2/ runners + model_states, omni schedulers, stage engine pipeline,
pooling_output serialization bridge). Content already merged to main
separately (step_audio2, tts_adapters, npu/_310p, etc.) drops out.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-20 07:19:40 +00:00
longguo and npuichigo
73df8326d7
[Bugfix] purge chunk-transfer zombies on every schedule tick to keep engine-core alive on aborts ( fixes #3736 ) ( #3774 )
...
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com >
Co-authored-by: npuichigo <11533479+npuichigo@users.noreply.github.com >
2026-06-10 09:00:23 +08:00
ChenWenjing
3842970a82
[bugfix] fix streaming input issue after rebase 0.22.0 ( #4085 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-06-03 16:07:41 +08:00
TaffyOfficial and TaffyOfficial
ee33601571
[Perf] Deduplicate AR prefix cache hidden-state CPU staging ( #3734 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-06-01 09:35:07 +00:00
ChenWenjing
5dfdf584dd
[Feat]audio streaming input for async chunk ( #3614 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-05-31 17:39:25 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
Lancer and Alicia
5c3c81920b
[Bugfix] Ensure stage and diffusion subprocesses exit when parent dies unexpectedly ( #3751 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-05-28 08:22:04 +08:00
Yueqian Lin and Rein Yang
e996723bc9
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness ( #3665 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
the ci failure case is irrelavent to this PR and occurs rarely
2026-05-25 23:09:38 +08:00
NATURE and Hongsheng Liu
82a0b3a467
[2/5] [core]refactor communication layer: PR 2 of 5 Qwen3 Omni non async ( #2677 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-15 14:14:08 +08:00
dsinghvi
e40076e872
[Refactor] msgspec standardisation for data entry key names and improved type checks ( #3149 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
2026-05-12 14:30:13 +08:00
wangyu
8a9add1c81
[CI] Restructure vLLM-Omni Test Layout, Fixture Scope, and Support Modules ( #2620 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-20 14:23:42 +08:00
ChenWenjing
4124a1f858
[Feature]Support audio streaming input and output-phase2 ( #2581 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-04-18 15:42:41 +08:00
Alex Brooks
f1e3f03726
[feature] Hidden State Prefix Caching ( #2164 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-15 17:01:45 +00:00
Yuanheng Zhao
e0cdbe9a5d
[Misc] Cleanup: use consistent pytest-mock in unit tests ( #2698 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-13 19:21:42 +08:00
NATURE and Hongsheng Liu
0d4e975e1b
[core]refactor communication layer: PR1(Added Refactor Infra Only) ( #1555 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-13 16:01:14 +08:00
zhumingjue138
e6f88f7c5a
[CI] Reorganize the L1 L2 use cases and add markers ( #2449 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
2026-04-09 10:31:21 +08:00
Du Bin
b4a96b0db4
[Bugfix] Restore chunk-waiting requests on OmniNewRequestData rewrap failure ( #1691 )
...
Signed-off-by: dubin555 <dubin555@gmail.com >
Signed-off-by: OSS Scout <scout@oss-scout.local >
2026-03-22 14:32:51 +08:00
