tzhouam
ec3814f587
debug
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-12 14:20:57 +00:00
Taichang Zhou and Cursor
e2ced80d59
Merge origin/main into dev/rebase-v0.16.0.
...
Resolve arg_utils merge conflict and align CI base image tag to v0.16.0 for the vLLM rebase track.
Co-authored-by: Cursor <cursoragent@cursor.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
2026-02-12 21:18:03 +08:00
ab1acb27ff
[Feature]async scheduling to overlap chunk IO and compute ( #951 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Bhanu068 <voutharoja.bhanu06@gmail.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-02-12 16:05:02 +08:00
tzhouam
064595a97c
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-10 02:22:49 +00:00
Junhong Liu and Hongsheng Liu
9af6fb9a1f
[Feature] Opt metrics structure ( #891 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 19:17:32 +08:00
tzhouam
7e4a604d4d
reabse 2025/2/9
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-09 03:07:43 +00:00
amy-why-3459
5304bc1e16
[Refactor] Refactor async chunk and fix the shape mismatch issue ( #1151 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-04 00:00:56 +08:00
amy-why-3459 and Hongsheng Liu
e6b9d52905
[BugFix] Modify max_tokens and modify the log and fix #1103 ( #1097 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 01:50:23 +13:00
NATURE
790e34e375
[Bugfix] Remove Mooncake/Yuanrong connector import warning ( #1091 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-01-30 13:26:29 +08:00
amy-why-3459 and Rein Yang
dd518973de
[BugFix] Fix the accuracy issue of multimodal input. ( #1020 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
2026-01-29 19:30:11 +08:00
汪志鹏
741f7e2826
[Core]: KV Cache Transfer Encapsulation ( #979 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-01-28 23:12:45 +08:00
amy-why-3459
d2b3a24af3
[BugFix] Modify the method of obtaining external_request_id ( #961 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-01-27 20:56:02 +08:00
yangsonglin13
16be03b909
[Feature] Implement YuanrongConnector based on OmniConnectorBase ( #716 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-01-27 20:17:02 +08:00
Yueqian Lin
77ff875170
Support Qwen3 tts online serving ( #968 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-01-27 14:37:21 +08:00
52bf1e2f40
[Feature]Support async computation and communication across stages by chunks ( #727 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-26 11:21:24 +08:00
汪志鹏 and wzliu
7f821be57b
Support Bagel Model ( #726 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: wzliu <wzliu@connect.hku.hk >
2026-01-22 23:09:55 +13:00
Gao Han
9c7de5373a
[Feature]Basic version of supporting streaming output ( #367 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-01 03:02:04 +13:00
Ziming Huang and Hongsheng Liu
ad0224f2e6
[Feature] Support Omni serving abort request ( #486 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-31 16:14:03 +08:00
Canlin Guo
97a5860681
[Security][Feature] Use Msgpack in OmniSerializer instead of pickle ( #310 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2025-12-22 13:21:16 +13:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
Cyrus Leung
c091a03d82
[Chore] Bump Python version and apply formatting changes for v0.12 release ( #126 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2025-12-16 15:19:40 +08:00
NATURE
f995211da0
[Feature] Omni Connector + ray supported ( #215 )
...
Signed-off-by: wzliu <wzliu@connect.hku.hk >
2025-12-10 20:15:03 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
Samit
8cafb4294d
[Docs] Setup Documentation System and Re-organize Dependencies ( #49 )
...
Signed-off-by: SamitHuang <285365963@qq.com >
2025-11-15 21:45:43 +08:00
hsliu
8e075d4917
update dirs
2025-09-11 15:56:28 +08:00
tzhouam