 amy-why-3459
|
b88d3ce75e
|
[BugFix] Fixing occasional engine crashes caused by abort requests (#2871)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-17 09:15:35 +00:00 |
|
|
NATUREandHongsheng Liu
|
4d816ff1de
|
[Feature] Bagel: Support tp+cfg parallel using mooncake transfer engine connector (#2705)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-16 16:25:13 +08:00 |
|
|
NATURE
|
6d01a8b506
|
[Omni Connector] Omni Transfer Engine Connector: Enable 1-receiver-to-N-senders to support Bagel TP/CFG parallel (#2731)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-04-14 16:06:37 +08:00 |
|
|
|
c3c736d488
|
[Feature] Port Bagel RDMA flow to latest main (#2000)
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: ahengljh <ahengljh@users.noreply.github.com>
Co-authored-by: natureofnature <wzliu@connect.hku.hk>
|
2026-04-08 14:55:35 +08:00 |
|
|
pikaxingeandAlicia
|
c9dbc0955b
|
[Bugfix] Prevent Silent Stage Dropouts: fix coordinator reconnect bug, close/update race, and heartbeat stall (#1899)
Signed-off-by: pikaxinge <2392811793@qq.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-04-08 00:48:26 +08:00 |
|
|
indevnandlinyueqian
|
6fc38e0467
|
[Model][Core] Enable async_chunk streaming pipeline for CosyVoice3 (#1703)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: indevn <indevn@outlook.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
|
2026-04-05 06:11:33 +00:00 |
|
|
Du Bin
|
69652a2983
|
[Bugfix] Fix memory leak: missing chunk_transfer_adapter.cleanup() in OmniARScheduler (#2028)
Signed-off-by: dubin555 <dubin555@gmail.com>
Signed-off-by: OSS Scout <scout@oss-scout.local>
|
2026-03-24 10:52:31 -04:00 |
|
|
Juan Pablo Zuluaga
|
ec6ee1e336
|
[Bugfix][Chunk Transfer Adapter] deque mutated fix (#2102)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
|
2026-03-23 13:09:04 -04:00 |
|
|
汪志鹏andDidan Deng
|
77d773ad47
|
[Bagel]: Support SP (#1903)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-23 21:52:50 +08:00 |
|
|
Zhou Taichangandgcanlin
|
a90a7690b8
|
[Rebase] Rebase to vllm v0.18.0 (#2037)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-21 20:37:38 +08:00 |
|
|
Sy03andsy0307
|
072647eeb2
|
[Perf] Improve Fish Speech S2 Pro inference performance (#1859)
Signed-off-by: sy0307 <sy0307@users.noreply.github.com>
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: sy0307 <sy0307@users.noreply.github.com>
|
2026-03-21 01:15:02 -04:00 |
|
|
|
fc5e8f825e
|
[Optim][Qwen3TTS] big boost model throughput+latency high concurrency (#1852)
Signed-off-by: pablo <pablo@agigo.ai>
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: pablo <pablo@agigo.ai>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-18 12:22:05 -04:00 |
|
|
Canlin Guo
|
d636c32ff9
|
[Bugfix] Set PREEMPTED status when moving requests from running to waiting queue (#1893)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-18 17:56:13 +08:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
Juan Pablo Zuluaga
|
cf328eb8e8
|
[Bug][Qwen3TTS][Streaming] remove dynamic initial chunk and only compute on initial request (#1930)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
|
2026-03-16 15:23:09 -04:00 |
|
|
Jinheng
|
88caaf182b
|
[Feature] Split #1303 Part 1: PD disaggregation scaffolding (#1863)
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
|
2026-03-16 14:05:19 +08:00 |
|
|
Daniel HuangandSYLAR
|
0e005817f7
|
[Enhancement] Patch OmniStage.try_collect() with ray alive checks (#1561)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
Signed-off-by: Daniel Huang <pilotflyer824@gmail.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-03-12 12:08:34 +08:00 |
|
|
NumberWan
|
617b1d6053
|
Add coordinator module and corresponding unit test (#1465)
Signed-off-by: Jeff Wan <wantszkin2003@gmail.com>
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-03-11 14:36:48 +08:00 |
|
|
Juan Pablo Zuluagaandpablo
|
1d0a97f0d1
|
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load (#1714)
Signed-off-by: pablo <pablo@agigo.ai>
Co-authored-by: pablo <pablo@agigo.ai>
|
2026-03-10 21:02:33 +00:00 |
|
|
汪志鹏
|
7271116973
|
[Bagel]: Support multistage img2img (#1669)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-09 22:23:50 +08:00 |
|
|
|
89b527e533
|
Dev/rebase v0170 (#1639)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-03-09 17:29:38 +08:00 |
|
|
Ziming Huang
|
070ea0ddc3
|
[Optimize][Qwen3-Omni] Reduce inter-packet latency in async chunk (#1656)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2026-03-05 22:26:30 +08:00 |
|
|
Junhong Liu
|
742d845b8e
|
Make chunk_size and left_context_size configurable via YAML for async chunking (#1423)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
|
2026-03-03 22:06:52 +08:00 |
|
|
汪志鹏andCursor
|
e37a89ffcb
|
[Feature]: Support cfg kv-cache transfer in multi-stage (#1422)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-03-02 05:06:28 +00:00 |
|
|
汪志鹏
|
3d9fa8d53f
|
[BugFix]: fix a lot of bug (#1565)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-02-28 16:26:56 +08:00 |
|
|
Sy03
|
0cc3481acf
|
[Feat] : Support Async chunk cleanup (#1087)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-02-27 14:39:33 +08:00 |
|
|
amy-why-3459
|
66c3e04263
|
[Performance]Qwen3-Omni performance optimization (#1378)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-02-26 21:21:36 +08:00 |
|
|
junuxyzandHongsheng Liu
|
caed95fb45
|
[Bugfix] Fix tuple/list KV cache extraction crash (#1405)
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-26 15:20:40 +08:00 |
|
|
NATURE
|
1589931fa6
|
[Feature] vLLM-Omni RDMA connector (#1019)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-02-24 11:13:52 +08:00 |
|
|
Sy03andHongsheng Liu
|
efbe4116ff
|
[Feature] : Support disaggregated inference pipeline for Qwen3_TTS (#1161)
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-21 07:36:44 +08:00 |
|
|
|
75770c9309
|
[Rebase] Rebase to vllm v0.16.0 (#1357)
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2026-02-13 18:05:07 +08:00 |
|
|
|
ab1acb27ff
|
[Feature]async scheduling to overlap chunk IO and compute (#951)
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
Co-authored-by: Gao Han <gaohan19@huawei.com>
|
2026-02-12 16:05:02 +08:00 |
|
|
Junhong LiuandHongsheng Liu
|
9af6fb9a1f
|
[Feature] Opt metrics structure (#891)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-09 19:17:32 +08:00 |
|
|
amy-why-3459
|
5304bc1e16
|
[Refactor] Refactor async chunk and fix the shape mismatch issue (#1151)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-02-04 00:00:56 +08:00 |
|
|
amy-why-3459andHongsheng Liu
|
e6b9d52905
|
[BugFix] Modify max_tokens and modify the log and fix #1103 (#1097)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-31 01:50:23 +13:00 |
|
|
NATURE
|
790e34e375
|
[Bugfix] Remove Mooncake/Yuanrong connector import warning (#1091)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-01-30 13:26:29 +08:00 |
|
|
amy-why-3459andRein Yang
|
dd518973de
|
[BugFix] Fix the accuracy issue of multimodal input. (#1020)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-01-29 19:30:11 +08:00 |
|
|
汪志鹏
|
741f7e2826
|
[Core]: KV Cache Transfer Encapsulation (#979)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-01-28 23:12:45 +08:00 |
|
|
amy-why-3459
|
d2b3a24af3
|
[BugFix] Modify the method of obtaining external_request_id (#961)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-01-27 20:56:02 +08:00 |
|
|
yangsonglin13
|
16be03b909
|
[Feature] Implement YuanrongConnector based on OmniConnectorBase (#716)
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com>
|
2026-01-27 20:17:02 +08:00 |
|
|
Yueqian Lin
|
77ff875170
|
Support Qwen3 tts online serving (#968)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-01-27 14:37:21 +08:00 |
|
|
|
52bf1e2f40
|
[Feature]Support async computation and communication across stages by chunks (#727)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-26 11:21:24 +08:00 |
|
|
汪志鹏andwzliu
|
7f821be57b
|
Support Bagel Model (#726)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: wzliu <wzliu@connect.hku.hk>
|
2026-01-22 23:09:55 +13:00 |
|
|
Gao Han
|
9c7de5373a
|
[Feature]Basic version of supporting streaming output (#367)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2026-01-01 03:02:04 +13:00 |
|
|
Ziming HuangandHongsheng Liu
|
ad0224f2e6
|
[Feature] Support Omni serving abort request (#486)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 16:14:03 +08:00 |
|
|
Canlin Guo
|
97a5860681
|
[Security][Feature] Use Msgpack in OmniSerializer instead of pickle (#310)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2025-12-22 13:21:16 +13:00 |
|
|
|
8939eb835d
|
[Rebase] Rebase to vllm 0.12.0 (#335)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2025-12-19 16:42:02 +08:00 |
|
|
Cyrus Leung
|
c091a03d82
|
[Chore] Bump Python version and apply formatting changes for v0.12 release (#126)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-12-16 15:19:40 +08:00 |
|
|
NATURE
|
f995211da0
|
[Feature] Omni Connector + ray supported (#215)
Signed-off-by: wzliu <wzliu@connect.hku.hk>
|
2025-12-10 20:15:03 +08:00 |
|
|
Gao Han
|
c5a89302f1
|
[Feature] Support online inference (#64)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
|
2025-11-17 14:44:10 +08:00 |
|