Sy03
30d28a9a04
[Test] Consolidate MOSS-TTS batching regression coverage
...
Combine overlapping row/snapshot checks, cover masked and valid attention rows in one batch, reuse the real codec session in grouping tests, and move output-policy coverage into the existing entrypoint module. Preserve both CUDA synchronization regressions and reduce the added suite from 29 to 15 cases.
Signed-off-by: Sy03 <1370724210@qq.com >
2026-09-08 03:03:32 +08:00
Sy03
55855fee9c
[Model] Reduce MOSS-TTS Local intermediate output overhead
...
Keep internal talker control outputs FINAL_ONLY while codec audio remains incremental. Reapply pipeline sampling constraints after default streaming coercion, log routine coercions at debug level, and cover explicit/default parameters with regression tests. Document matched high-concurrency statistics settings.
Signed-off-by: Sy03 <1370724210@qq.com >
2026-09-08 01:15:46 +08:00
7ae15c74c8
text and image metric ( #6150 )
...
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-08-26 02:54:45 +00:00
maithilijoshi20 and Hongsheng Liu
bd4f9acfd3
[Bugfix] Preserve pipeline sampling constraints ( #6182 )
...
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-22 14:57:09 +00:00
fcf1085395
[Refactor][OutputProcessor 2/8]: OmniRequestOutput should inherit RequestOutput and no nested wrap-up ( #5146 )
...
Signed-off-by: Boao Shi <aoibosh@connect.hku.hk >
Signed-off-by: bowieshi <aoibosh@connect.hku.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Shi Boao Bowie <aoibosh@connect.hku.hk >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: ruirui(rein) yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-12 22:58:23 +08:00
ee118ab492
[Bugfix] Per-replica fault isolation: keep API server alive on single-stage death ( #4285 ) ( #4583 )
...
Signed-off-by: Shenglei Fu <sfu@confluent.io >
Signed-off-by: Shenglei Fu <117230642+ShengleiFu@users.noreply.github.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-10 23:00:18 -04:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
Alex Brooks
b7d08fe5f6
[Core / Bugfix] Add Mechanism for Endpoint Rejection ( #4762 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-07-08 09:00:47 -06:00
MaciejBalaNV and Hongsheng Liu
03cc888485
[refactor] Refactor guardrail error handling - add 400 error code ( #4297 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-11 21:09:24 +00:00
bdfc77147d
[Diffusion] DreamZero world model integration with CFG parallel + OpenPI serving ( #2162 )
...
Signed-off-by: Meng <meng_chen99@163.com >
Signed-off-by: Yangshen Deng <yangshen.d@outlook.com >
Signed-off-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: Meng <meng_chen99@163.com >
Co-authored-by: Suli Wang <50828270+wsl2000@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-02 19:50:20 +00:00
Alex Brooks
12e75c6618
[Core] Integrate TrackingArgumentParser ( #3369 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-02 21:56:24 +08:00
Alex Brooks and Hongsheng Liu
8d13b54383
[CI/Bugfix] Async Request ID Aliasing ( #3953 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-30 16:59:42 +08:00
Haco and zzhuoxin1508
37eebff674
[BugFix] Fix diffusion parallel_config YAML override and add deploy config field allowlist ( #3483 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: zzhuoxin1508 <zzhuoxin1508@users.noreply.github.com >
2026-05-28 01:00:32 +08:00
wuhang and Hongsheng Liu
0f4853ff86
[Bugfix] Support diffusion worker dead detect when use inline engine ( #3214 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-16 20:50:29 +08:00
wuhang
0d9d57acd9
[Entrypoint][Refactor] Make field type hint more concrete ( #3139 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
2026-05-14 11:25:55 +08:00
Haco
81ab2f98da
[Config Refactor] Remove legacy Omni CLI arg helper and align tests with nullified parser defaults ( #3144 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
2026-05-07 06:32:01 +08:00
Zhou Taichang and Yuanheng Zhao
7f2b1e9386
[Rebase] Rebase to vllm 0.20.0 ( #3232 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-04-30 09:56:59 +12:00
Haco and lishunyang
22ffb85063
[Config Refactor] sentinel default precedence ( #3078 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-04-24 20:07:24 +08:00
wuhang
fd9a0ee27f
[Feature] Failure message shows more details ( #2961 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
2026-04-23 04:32:43 +08:00
52b53367ef
[Enhancement] Engine runtime errors ( #2426 )
...
Signed-off-by: Daniel Huang <daniel1.huang@intel.com >
Signed-off-by: Daniel Huang <pilotflyer824@gmail.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
2026-04-21 14:46:05 +08:00
Zhou Taichang
2804a85e58
[Rebase] Rebase to vllm v0.19.0 ( #2475 )
2026-04-04 15:03:32 +08:00
WeiQing Chen
1eee8435e1
[Bugfix] fix: return 400 for unsupported multi-image edits such as Qwen-Image-Layered ( #2298 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-03-30 20:24:57 +08:00
Peiqi Yin
df93b3a965
[Unit Test] add unit tests for AsyncOmni and Omni ( #2034 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
2026-03-23 23:17:12 +08:00
Sy03