 catcat
|
7961eb6a02
|
[Bugfix] Fix on_finalize_request method arguments number mismatch (#583)
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
|
2026-01-04 09:51:46 +08:00 |
|
|
Hongsheng Liu
|
d7062550d7
|
[Core] omni refactor: optimize stage initialization polling and troubleshooting logs (#575)
Signed-off-by: hsliu <liuhongsheng4@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-02 11:31:31 +08:00 |
|
|
Canlin GuoandHongsheng Liu
|
4f8cb95571
|
[Metric] Fix the computation of e2e_total_tokens (#519)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-01 00:13:17 +08:00 |
|
|
|
680742bc33
|
[Diffusion]: Diffusion Ring Attention support (#273)
Signed-off-by: mxuax <mxuax@connect.ust.hk>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 14:26:30 +00:00 |
|
|
Gao Han
|
9c7de5373a
|
[Feature]Basic version of supporting streaming output (#367)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2026-01-01 03:02:04 +13:00 |
|
|
Ziming HuangandHongsheng Liu
|
ad0224f2e6
|
[Feature] Support Omni serving abort request (#486)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 16:14:03 +08:00 |
|
|
|
23bf317cc5
|
[New Model]Bagel model(Diffusion Only) (#319)
Signed-off-by: wzliu <wzliu@connect.hku.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: wzliu <wzliu@connect.hku.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 13:47:35 +08:00 |
|
|
SYLARandHongsheng Liu
|
380c43eb86
|
[Feature] Add tqdm in Omni pipeline to align with Vllm (#552)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 04:44:11 +08:00 |
|
|
Peiqi YinandHongsheng Liu
|
2eebd22e32
|
[BugFix] __del__ exit don't join the spawned process (#555)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-31 03:59:25 +08:00 |
|
|
Gao Han
|
194fa159a3
|
[Bugfix]fix proces close problem for omni class (#554)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-31 08:23:54 +13:00 |
|
|
|
f0b8d3db82
|
[Feature] Control the stage init timeout threshold by --stage-init-timeout (#393)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Li Shunyang <gmsv2544@nus.edu.sg>
Signed-off-by: Li Shunyang <lishunyang12@163.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Signed-off-by: dengyunyang <584797741@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: dengyunyang <584797741@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2025-12-30 23:37:10 +08:00 |
|
|
WeiQing ChenandHongsheng Liu
|
1753a878e0
|
[Bugfix] t2i online fix cache configuration failure and errors in /v1/images/generation endpoint. (#499)
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-30 16:50:30 +08:00 |
|
|
|
ebe37e9f57
|
[Refactor] let the AsyncOmni class inherit from Omni class (#511)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-29 21:04:17 +08:00 |
|
|
Peiqi YinandHongsheng Liu
|
60143adc52
|
[Core] remove deparated code from PR391 (#502)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-28 21:11:37 +13:00 |
|
|
|
2f69748ee4
|
add openai create speech endpoint (#305)
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
Signed-off-by: Bhanu Prakash Voutharoja <59905694+Bhanu068@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2025-12-27 13:56:51 +08:00 |
|
|
Ziming HuangandHongsheng Liu
|
d456721d81
|
[BugFix] Make max_batch_size work in Omni online serving (#487)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-26 21:51:07 +08:00 |
|
|
|
595e7c0032
|
[Core] Supports stage abstraction in the diffusion model (#391)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-27 01:59:33 +13:00 |
|
|
Junhong Liu
|
51eefbfebc
|
[BugFix] initial sampling_params_list when offline inference (#468)
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
|
2025-12-26 13:54:12 +08:00 |
|
|
dengyunyangandHongsheng Liu
|
a500ca1f28
|
[Feature] logger refactor (#466)
Signed-off-by: dengyunyang <584797741@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2025-12-26 08:42:06 +08:00 |
|
|
Ziming Huang
|
1a7dcdf65c
|
[Feature] Support Qwen Omni online batch inference (#438)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2025-12-25 19:38:48 +08:00 |
|
|
Wonjae Leeandwonjae.lee0
|
341457a121
|
[Feature] Support standard OpenAI API sampling parameters for thinker stage. (max_tokens...) (#450)
Signed-off-by: wonjae.lee0 <wonjae.lee0@navercorp.com>
Co-authored-by: wonjae.lee0 <wonjae.lee0@navercorp.com>
|
2025-12-24 20:39:01 +08:00 |
|
|
Doug Smith
|
74c142460d
|
DALL-E compatible image generation endpoint (#292)
Signed-off-by: dougbtv <dosmith@redhat.com>
|
2025-12-23 09:05:37 +08:00 |
|
|
Peiqi Yin
|
0e878a92d2
|
[BugFix] raise error when request.stream=True. (#350)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
|
2025-12-23 08:52:18 +08:00 |
|
|
dsinghvi
|
92c20afdc1
|
[Feature]: Adding traceback for error in background worker (#385)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
|
2025-12-22 13:21:53 +13:00 |
|
|
TJianandHongxia Yang
|
13584fd98e
|
[ROCm] [CI] Add ROCm Dockerfile and AMD CI (vllm v0.12.0) (#280)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
|
2025-12-21 11:51:37 +08:00 |
|
|
rein yang
|
c591ea124f
|
[Bugfix] fix GPU VRAM calculation problem (#328)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2025-12-19 19:21:33 +08:00 |
|
|
WeiQing Chen
|
628c0a9217
|
[Entrypoints] Support Qwen-Image-Edit 2509 online serving & update doc (#368)
Signed-off-by: David Chen <530634352@qq.com>
|
2025-12-19 16:50:32 +08:00 |
|
|
|
8939eb835d
|
[Rebase] Rebase to vllm 0.12.0 (#335)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2025-12-19 16:42:02 +08:00 |
|
|
WeiQing Chen
|
9464e1479d
|
[Entrypoints] online serving support usp args (#366)
Signed-off-by: David Chen <530634352@qq.com>
|
2025-12-19 11:59:07 +08:00 |
|
|
Gao Han
|
c4cd502d82
|
[Misc] Fix left comments for PR298 (#346)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-17 22:40:20 +08:00 |
|
|
Chenguang Zhengandyinpe
|
acf66ee2cc
|
[Entrypoints] Support Online Serving for Diffusion-only Models (#259)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
|
2025-12-17 17:40:45 +08:00 |
|
|
Gao Han
|
8722c6374c
|
[Feature] Support output modalities control per request (#298)
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-17 17:19:56 +08:00 |
|
|
TJian
|
f785a5d401
|
[Bugfix] [Example] Add fallback to worker_backend and ray_address in AsyncOmni to fix gradio demos (#337)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2025-12-17 01:37:58 +00:00 |
|
|
dengyunyang
|
bd53347615
|
[Feature] Send response with request id (#301)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2025-12-16 15:41:42 +00:00 |
|
|
Cyrus Leung
|
c091a03d82
|
[Chore] Bump Python version and apply formatting changes for v0.12 release (#126)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-12-16 15:19:40 +08:00 |
|
|
dengyunyang
|
bd5c81cb7e
|
[BugFix] Failed to print DEBUG level log (#307)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2025-12-15 07:13:36 +00:00 |
|
|
Jiangyun Zhu
|
9c03b80428
|
[Misc] move omni_diffusion.py to vllm_omni.entrypoints (#312)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2025-12-15 12:54:31 +08:00 |
|
|
|
65ca13102d
|
[Feature] teacache integration (#179)
Signed-off-by: Prajwal A <prajwalanagani@gmail.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2025-12-12 04:29:56 +00:00 |
|
|
LancerandLancer
|
0548674d30
|
[Entrypoints] Minor optimization in the orchestrator's final stage determination logic (#275)
Signed-off-by: Lancer <maruixiang6688@gmai.com>
Co-authored-by: Lancer <maruixiang6688@gmail.com>
|
2025-12-11 17:59:00 +08:00 |
|
|
NATURE
|
f995211da0
|
[Feature] Omni Connector + ray supported (#215)
Signed-off-by: wzliu <wzliu@connect.hku.hk>
|
2025-12-10 20:15:03 +08:00 |
|
|
汪志鹏
|
71f9f9a9a7
|
[Bugfix] Remove debug code in AsyncOmni.del to fix resource leak (#260)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2025-12-09 23:23:01 +08:00 |
|
|
WeiQing Chen
|
9a7f7b7de5
|
[Bugfix]multi-GPU tp scenarios, devices: "0,1" uses physical IDs instead of logical IDs (#253)
Signed-off-by: David Chen <530634352@qq.com>
|
2025-12-09 21:04:30 +08:00 |
|
|
Gao Han
|
45dc189d8d
|
[Bugfix] Support passing vllm cli args to online serving in vLLM-Omni (#206)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk>
|
2025-12-08 14:59:53 +08:00 |
|
|
Jiangyun Zhu
|
aa689e6af0
|
[Core] add clean up method for diffusion engine (#219)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2025-12-08 03:52:07 +00:00 |
|
|
Mengqing Cao
|
00b1a9a1a0
|
[Misc] Temporarily support downloading models from ModelScope by snapshot download (#132)
Signed-off-by: MengqingCao <cmq0113@163.com>
|
2025-12-01 17:13:23 +00:00 |
|
|
Roger Wang
|
c852267a1a
|
[Misc] Update default stage config for qwen3-omni (#124)
Signed-off-by: Roger Wang <hey@rogerw.io>
|
2025-11-30 20:01:20 -08:00 |
|
|
Alicia
|
a33bbcedea
|
[Fix] Resolve comments & update vLLM-Omni name usages. (#122)
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
|
2025-12-01 08:05:24 +08:00 |
|
|
Alicia
|
3427fb4774
|
[Feat] Rename AsyncOmniLLM -> AsyncOmni (#103)
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com>
|
2025-11-30 22:26:33 +08:00 |
|
|
Gao Han
|
bfd3cad5ee
|
[Bugfix] Fix bug of online serving for qwen2.5-omni (#118)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
|
2025-11-30 21:30:17 +08:00 |
|
|
Canlin Guo
|
ec9e04027d
|
[Feat] Add NPU Backend support for vLLM-Omni (#89)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2025-11-30 20:39:06 +08:00 |
|