 amy-why-3459andRein Yang
|
dd518973de
|
[BugFix] Fix the accuracy issue of multimodal input. (#1020)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-01-29 19:30:11 +08:00 |
|
|
Samit
|
c0beebbfe3
|
[Feature] Support cache-dit for Wan 2.2 inference (#1021)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
|
2026-01-28 20:07:50 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
d64bbde561
|
[Frontend][Model] Support batch request with refined OmniDiffusionReq… (#797)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-01-28 16:07:42 +08:00 |
|
|
|
5037af1033
|
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk>
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk>
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-01-27 10:22:40 +08:00 |
|
|
|
52bf1e2f40
|
[Feature]Support async computation and communication across stages by chunks (#727)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-26 11:21:24 +08:00 |
|
|
D!NE$H
|
5e7035e183
|
[Feature]: Add CFG param to online serving (#824)
Signed-off-by: Dinesh G <G.Dinesh@ibm.com>
Signed-off-by: gDINESH13 <dinesh13g@gmail.com>
|
2026-01-19 04:23:15 +00:00 |
|
|
Yuhan Liu
|
e213bdd0a4
|
[BugFix]Remove duplicate error handling for request results (#781)
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com>
|
2026-01-14 20:08:23 +08:00 |
|
|
JustQJ
|
9cdf592782
|
[Misc] Enable tensor_parallel_size argument with online serving cmd (#761)
Signed-off-by: TangPeng <85704592@qq.com>
|
2026-01-13 15:55:25 +08:00 |
|
|
Prajwal Aandzjy0516
|
779f5987d9
|
[feature] cpu offloading support for diffusion (#497)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Prajwal A <prajwalanagani@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-01-12 10:41:18 +00:00 |
|
|
Ziming Huang
|
cddcc400d3
|
[BugFix] Fix stage engine outputs mismatch bug in online batching (#691)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2026-01-09 04:01:57 +13:00 |
|
|
Junhong Liu
|
bb13467adc
|
[Bug fix] fix e2e_total_tokens and e2e_total_time_ms (#648)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
|
2026-01-08 20:25:04 +08:00 |
|
|
Canlin Guoandlishunyang
|
52afcb6055
|
[Feature] Support torch profiler across omni stages (#553)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-01-05 17:32:20 +08:00 |
|
|
catcat
|
7961eb6a02
|
[Bugfix] Fix on_finalize_request method arguments number mismatch (#583)
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
|
2026-01-04 09:51:46 +08:00 |
|
|
Gao Han
|
9c7de5373a
|
[Feature]Basic version of supporting streaming output (#367)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2026-01-01 03:02:04 +13:00 |
|
|
Ziming HuangandHongsheng Liu
|
ad0224f2e6
|
[Feature] Support Omni serving abort request (#486)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 16:14:03 +08:00 |
|
|
Peiqi YinandHongsheng Liu
|
2eebd22e32
|
[BugFix] __del__ exit don't join the spawned process (#555)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 03:59:25 +08:00 |
|
|
|
f0b8d3db82
|
[Feature] Control the stage init timeout threshold by --stage-init-timeout (#393)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Li Shunyang <gmsv2544@nus.edu.sg>
Signed-off-by: Li Shunyang <lishunyang12@163.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Signed-off-by: dengyunyang <584797741@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: dengyunyang <584797741@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2025-12-30 23:37:10 +08:00 |
|
|
WeiQing ChenandHongsheng Liu
|
1753a878e0
|
[Bugfix] t2i online fix cache configuration failure and errors in /v1/images/generation endpoint. (#499)
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-30 16:50:30 +08:00 |
|
|
|
ebe37e9f57
|
[Refactor] let the AsyncOmni class inherit from Omni class (#511)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-29 21:04:17 +08:00 |
|
|
Peiqi YinandHongsheng Liu
|
60143adc52
|
[Core] remove deparated code from PR391 (#502)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-28 21:11:37 +13:00 |
|
|
|
595e7c0032
|
[Core] Supports stage abstraction in the diffusion model (#391)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-27 01:59:33 +13:00 |
|
|
dengyunyangandHongsheng Liu
|
a500ca1f28
|
[Feature] logger refactor (#466)
Signed-off-by: dengyunyang <584797741@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-26 08:42:06 +08:00 |
|
|
|
8939eb835d
|
[Rebase] Rebase to vllm 0.12.0 (#335)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2025-12-19 16:42:02 +08:00 |
|
|
Gao Han
|
8722c6374c
|
[Feature] Support output modalities control per request (#298)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-17 17:19:56 +08:00 |
|
|
TJian
|
f785a5d401
|
[Bugfix] [Example] Add fallback to worker_backend and ray_address in AsyncOmni to fix gradio demos (#337)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2025-12-17 01:37:58 +00:00 |
|
|
dengyunyang
|
bd53347615
|
[Feature] Send response with request id (#301)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2025-12-16 15:41:42 +00:00 |
|
|
Cyrus Leung
|
c091a03d82
|
[Chore] Bump Python version and apply formatting changes for v0.12 release (#126)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-12-16 15:19:40 +08:00 |
|
|
LancerandLancer
|
0548674d30
|
[Entrypoints] Minor optimization in the orchestrator's final stage determination logic (#275)
Signed-off-by: Lancer <maruixiang6688@gmai.com>
Co-authored-by: Lancer <maruixiang6688@gmail.com>
|
2025-12-11 17:59:00 +08:00 |
|
|
NATURE
|
f995211da0
|
[Feature] Omni Connector + ray supported (#215)
Signed-off-by: wzliu <wzliu@connect.hku.hk>
|
2025-12-10 20:15:03 +08:00 |
|
|
汪志鹏
|
71f9f9a9a7
|
[Bugfix] Remove debug code in AsyncOmni.del to fix resource leak (#260)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2025-12-09 23:23:01 +08:00 |
|
|
Gao Han
|
45dc189d8d
|
[Bugfix] Support passing vllm cli args to online serving in vLLM-Omni (#206)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-08 14:59:53 +08:00 |
|
|
Roger Wang
|
c852267a1a
|
[Misc] Update default stage config for qwen3-omni (#124)
Signed-off-by: Roger Wang <hey@rogerw.io>
|
2025-11-30 20:01:20 -08:00 |
|
|
Alicia
|
a33bbcedea
|
[Fix] Resolve comments & update vLLM-Omni name usages. (#122)
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
|
2025-12-01 08:05:24 +08:00 |
|
|
Alicia
|
3427fb4774
|
[Feat] Rename AsyncOmniLLM -> AsyncOmni (#103)
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
|
2025-11-30 22:26:33 +08:00 |
|