 tzhouam
|
3663e803d1
|
rebase 2026/02/11
vllm: 4a1550d22d7058e129d0e1257e726b3bf4a77025
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-11 02:43:49 +00:00 |
|
|
tzhouam
|
279b6b5050
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-02-11 01:44:54 +00:00 |
|
|
Canlin Guo
|
e192b0a6c5
|
[Misc] Add per-request generator_device to online image gen and edit (#1183)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-02-10 18:47:08 +08:00 |
|
|
amy-why-3459
|
ee624d0686
|
[BugFix] Fixed the issue where ignore_eos was not working. (#1286)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-02-10 16:08:20 +08:00 |
|
|
zhou zhuoxinandCopilot
|
109bb97b2c
|
[Fix]Ensure HuggingFace downloads complete before initialization. (#1213)
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-02-10 16:05:12 +08:00 |
|
|
tzhouam
|
064595a97c
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-02-10 02:22:49 +00:00 |
|
|
Jiaping Wu
|
5fea4823b7
|
[Model] SupportHunyuanImage3 Diffusion Model in vllm-omni (#1085)
Signed-off-by: Semmer2 <semmer@live.cn>
|
2026-02-10 03:03:44 +13:00 |
|
|
Junhong LiuandHongsheng Liu
|
9af6fb9a1f
|
[Feature] Opt metrics structure (#891)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-09 19:17:32 +08:00 |
|
|
Chenguang Zheng
|
c6b526bc2e
|
fix: add diffusion offload args to OmniConfig group instead of serve_parser (#1271)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
|
2026-02-09 11:46:00 +08:00 |
|
|
tzhouam
|
7e4a604d4d
|
reabse 2025/2/9
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-09 03:07:43 +00:00 |
|
|
tzhouamandCursor
|
03c6a58f69
|
Merge origin/main into dev/vllm-align; resolve omni_stage.py conflicts
Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-09 01:52:31 +00:00 |
|
|
dsinghvi
|
59024bee62
|
Process-Scoped GPU Memory Accounting (#1204)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
|
2026-02-08 22:43:02 +08:00 |
|
|
ApsarasX
|
87847a214a
|
[Bugfix] Ensure seed=0 is correctly handled in image edit (#1248)
Signed-off-by: ApsarasX <apsarax@outlook.com>
|
2026-02-07 07:09:54 +08:00 |
|
|
ApsarasX
|
10f841bb98
|
[Bugfix] Fix '--max-generated-image-size' cli args type (#1249)
Signed-off-by: ApsarasX <apsarax@outlook.com>
|
2026-02-06 21:44:51 +08:00 |
|
|
tzhouam
|
41e22e2770
|
[Refactor] Clean up code by removing unnecessary lines and adding missing imports in async_omni_llm.py, omni_stage.py, omni.py, and api_server.py
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-05 11:02:03 +00:00 |
|
|
tzhouam
|
24b04f58a0
|
rebase 2026/2/5
|
2026-02-05 10:52:28 +00:00 |
|
|
Junhong LiuandHongsheng Liu
|
959b3ca8c8
|
[Bugfix] E2E metric incorrect qwen3-omni with async chunk feature (#1018)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-04 15:27:30 +08:00 |
|
|
Zhou Taichang
|
d6f93b0f37
|
[Debug] Correct Unreasonable Long Timeout (#1175)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-03 08:49:51 +00:00 |
|
|
Zhou Taichangand汪志鹏
|
70ef548448
|
Dev/rebase v0.15.0 (#1159)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-02-03 12:24:45 +08:00 |
|
|
ceanna93andanna
|
df3b347cd9
|
[Misc] Align error handling with upstream vLLM v0.14.0 (#1122)
Signed-off-by: anna <lee.anna@navercorp.com>
Co-authored-by: anna <lee.anna@navercorp.com>
|
2026-02-01 21:59:08 +08:00 |
|
|
dengyunyang
|
70a5de9dd4
|
[FEATURE] /v1/images/edit interface (#1101)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-01-31 14:13:36 +08:00 |
|
|
|
2e6895ff0e
|
[Bugfix][Qwen3TTS] Load speaker_id/voices from model configuration (#1079)
Signed-off-by: pablo <juanz9312@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-01-31 10:42:09 +08:00 |
|
|
Didan DengandHongsheng Liu
|
23cf48d7bb
|
[Perf]: CFG parallel abstraction (#851)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-30 16:23:44 +00:00 |
|
|
Jiangyun ZhuandHongsheng Liu
|
8ad39570b8
|
[Bugfix] fix request_id of image generation in api server (#1112)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-31 00:05:34 +08:00 |
|
|
|
2923d5a91e
|
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading (#858)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-01-30 17:35:09 +08:00 |
|
|
Pierre LE GUEN
|
2c294a750b
|
fix: UnboundLocalError for role in streaming audio/image responses (#784)
Signed-off-by: Pierre Le Guen <26087574+PierreLeGuen@users.noreply.github.com>
|
2026-01-30 16:27:04 +08:00 |
|
|
|
7bfd3c069d
|
[Benchmark] Add vLLM-Omni Omni model online benchmark (#780)
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-30 11:41:09 +08:00 |
|
|
dengyunyang
|
47a0969976
|
[Bugfix] pr conflict fix, bugfix ignore mm data from stages to async omni (#1025)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-01-29 17:09:34 +00:00 |
|
|
amy-why-3459andRein Yang
|
dd518973de
|
[BugFix] Fix the accuracy issue of multimodal input. (#1020)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-01-29 19:30:11 +08:00 |
|
|
Yueqian Lin
|
cac6504adf
|
[bugfix] remove vllm speech route (#1060)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-01-29 16:02:59 +08:00 |
|
|
NATURE
|
8306c91ea9
|
[BugFix] Fix noisy output without setting a seed in Qwen Image (#1043)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-01-29 15:39:26 +08:00 |
|
|
Canlin Guo
|
c9392dff01
|
[Hardware] Support platforms and plugin system (#774)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-01-28 22:12:52 +08:00 |
|
|
Samit
|
c0beebbfe3
|
[Feature] Support cache-dit for Wan 2.2 inference (#1021)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
|
2026-01-28 20:07:50 +08:00 |
|
|
Hongsheng Liu
|
91a3d465ee
|
Revert "[BugFix] ignore mm data from stages to async omni" (#1023)
|
2026-01-28 17:41:28 +08:00 |
|
|
dengyunyang
|
6fb4058566
|
[BugFix] ignore mm data from stages to async omni (#954)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-01-28 17:10:05 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
d64bbde561
|
[Frontend][Model] Support batch request with refined OmniDiffusionReq… (#797)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-01-28 16:07:42 +08:00 |
|
|
lif
|
c4220f0979
|
[BugFix] Add /health and /v1/models endpoints for diffusion mode, fix streaming compatibility (#454)
Signed-off-by: majiayu000 <1835304752@qq.com>
|
2026-01-28 13:11:15 +08:00 |
|
|
Yueqian Lin
|
9bca8880fe
|
Fix TTS speaker typo and add supported languages (#990)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-01-27 23:19:51 +08:00 |
|
|
Yueqian Lin
|
77ff875170
|
Support Qwen3 tts online serving (#968)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-01-27 14:37:21 +08:00 |
|
|
|
5037af1033
|
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk>
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk>
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-01-27 10:22:40 +08:00 |
|
|
SamitandHongsheng Liu
|
978a290d6e
|
[Bugfix] Fix diffusion pipeline CFG (guidance_scale parsing failure bug) (#922)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-26 05:09:03 +00:00 |
|
|
|
52bf1e2f40
|
[Feature]Support async computation and communication across stages by chunks (#727)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-26 11:21:24 +08:00 |
|
|
|
5d9918fa67
|
[Misc] Fix error log for the diffusion stage timeout (#915)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-01-23 15:16:40 +08:00 |
|
|
汪志鹏andwzliu
|
7f821be57b
|
Support Bagel Model (#726)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: wzliu <wzliu@connect.hku.hk>
|
2026-01-22 23:09:55 +13:00 |
|
|
Sihao Li
|
0aa72b952f
|
[bugfix] support text + audio mixed output (#843)
Signed-off-by: GG-li <3226868735@qq.com>
|
2026-01-21 17:44:17 +08:00 |
|
|
Chenguang Zheng
|
72a8553310
|
[Bugfix] Remove the duplicate api registration in vllm-omni (#880)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
|
2026-01-21 07:00:31 +00:00 |
|
|
+13
|
776c3a794e
|
Dev/rebase 0.14.0 (#847)
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Signed-off-by: root <root@hk01dgx039.cm.cluster>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: TangPeng <85704592@qq.com>
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com>
Signed-off-by: mxuax <mxuax@connect.ust.hk>
Signed-off-by: Sihyeon Jang <sihyeon.jang@navercorp.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com>
Signed-off-by: Dinesh G <G.Dinesh@ibm.com>
Signed-off-by: gDINESH13 <dinesh13g@gmail.com>
Signed-off-by: root <root@hk01dgx028.cm.cluster>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: JaredforReal <w13431838023@gmail.com>
Co-authored-by: root <root@hk01dgx039.cm.cluster>
Co-authored-by: JustQJ <37905360+JustQJ@users.noreply.github.com>
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com>
Co-authored-by: Sihyeon Jang <uneedsihyeon@gmail.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com>
Co-authored-by: Ziming Huang <hzm414167@alibaba-inc.com>
Co-authored-by: Yuhan Liu <30294295+liuyuhanalex@users.noreply.github.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: John Liu BUAA <liukecheng97@gmail.com>
Co-authored-by: D!NE$H <67671800+gDINESH13@users.noreply.github.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
|
2026-01-21 00:25:25 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
430c60b9b5
|
[Bugfix] Diffusion model fails to load when stage config is present (#860)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-01-20 12:42:26 +08:00 |
|
|
SYLAR
|
a1c37cc6e3
|
[Core] Implement Diffusion Profiler Support (#709)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-01-20 11:35:48 +08:00 |
|
|
D!NE$H
|
5e7035e183
|
[Feature]: Add CFG param to online serving (#824)
Signed-off-by: Dinesh G <G.Dinesh@ibm.com>
Signed-off-by: gDINESH13 <dinesh13g@gmail.com>
|
2026-01-19 04:23:15 +00:00 |
|