 tzhouam
|
f24273dc03
|
Update vLLM version to 0.16.0 in quickstart and CUDA installation documentation, and adjust parameters in multimodal generation script for improved performance. Refactor request logging in serving_chat.py for better input tracking.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-13 09:50:11 +00:00 |
|
|
tzhouam
|
31e9fdbb57
|
Refactor chat_utils to remove unused multi-modal classes and add async audio extraction from video. Update README to reflect new entry point for audio extraction. Enhance serving_chat to process audio from video URLs when specified.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-13 03:27:16 +00:00 |
|
|
tzhouam
|
7e9cae56fc
|
Refactor Dockerfile.ci to use precompiled VLLM installation and remove unused parse.py file. Update serving_chat.py to streamline rendering logic and enhance compatibility with new API. Modify OmniInputPreprocessor to directly handle SingletonDictPrompt, improving input processing efficiency.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-13 02:28:25 +00:00 |
|
|
knlnguyen1802
|
9994594782
|
[Misc] Support WorkerWrapperBase and CustomPipeline for Diffusion Worker (#764)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
|
2026-02-12 19:23:51 +08:00 |
|
|
WeiQing Chen
|
e427da022b
|
[Misc] wechat image update (#1354)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-02-12 18:46:56 +08:00 |
|
|
Aliciaandyenuo26
|
17e238c7ea
|
[DOC] Doc for CI test - Details about five level stucture and some other files. (#1167)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: yenuo26 <410167048@qq.com>
|
2026-02-12 18:43:51 +08:00 |
|
|
Yuanheng ZhaoandSamit
|
8bf849c399
|
Refactor CPU Offloading Backend Pattern (#1223)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-02-12 17:29:55 +08:00 |
|
|
Sihao Li
|
71c9e77606
|
[Feature] add Tensor Parallelism to SD_3.5 (#1336)
Signed-off-by: GG-li <3226868735@qq.com>
|
2026-02-12 07:33:23 +00:00 |
|
|
SYLAR
|
830d261f9d
|
[Feature]: FP8 Quantization Support for DiT (#1034)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-02-11 21:01:35 +08:00 |
|
|
Didan Deng
|
8e3dce781e
|
Unifying CLI Argument Naming Style (#1309)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-02-11 17:17:48 +08:00 |
|
|
Alicia
|
dc8b28e0aa
|
[Doc] Sync (#1216)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-02-11 11:00:43 +13:00 |
|
|
dongbo910220andhsliuustc0106
|
43e8747c00
|
[Feat]: support VAE patch parallelism (#756)
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-02-10 17:36:10 +08:00 |
|
|
Yueqian Lin
|
f55ce9c793
|
[Test] Add e2e tests for Qwen3-TTS speech endpoint (#1206)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-02-10 16:33:39 +08:00 |
|
|
Yueqian LinandHongsheng Liu
|
acfe99e4d9
|
[Doc] Update Qwen3-TTS docs for consistency with Omni examples (#1226)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-10 15:52:44 +08:00 |
|
|
JohnJan
|
f73fa1fbe7
|
[feature]: support Flux.1-dev CFG-Parallel (#1269)
|
2026-02-10 14:54:35 +08:00 |
|
|
Jiaping Wu
|
5fea4823b7
|
[Model] SupportHunyuanImage3 Diffusion Model in vllm-omni (#1085)
Signed-off-by: Semmer2 <semmer@live.cn>
|
2026-02-10 03:03:44 +13:00 |
|
|
Junhong LiuandHongsheng Liu
|
9af6fb9a1f
|
[Feature] Opt metrics structure (#891)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-09 19:17:32 +08:00 |
|
|
AliciaandHongsheng Liu
|
d3ea94309d
|
[CI] Add pytest markers to current tests and update the doc. (#577)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-09 16:49:45 +08:00 |
|
|
|
29e6a29e54
|
[Doc] Adding models/pipelines/features Tutorial (#1196)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
|
2026-02-09 15:53:01 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
2538ae6332
|
[ComfyUI]: ComfyUI integration (#1113)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-02-09 09:54:41 +08:00 |
|
|
SYLAR
|
01e0a8f284
|
[Bugfix] Fix Doc link Rrror (#1263)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-02-09 01:36:48 +13:00 |
|
|
SYLAR
|
2f97db17a3
|
[Doc] Update QA relevant to quantization (#1257)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-02-08 07:10:49 +08:00 |
|
|
SYLAR
|
a43dbdc064
|
[Docs] Add example image download step to Image-To-Video examples (#1258)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-02-07 13:14:53 +00:00 |
|
|
|
78a5aae299
|
[Hardware] [Feat] Setup platform dependent package installation (#1046)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: PopSoda2002 <zhouhp.me@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-02-05 21:47:41 +08:00 |
|
|
weichen
|
c4933ec2aa
|
[Wan 2.2][Diffusion] Add TP Support (#964)
Signed-off-by: weichen <calvin_zhu0210@outlook.com>
|
2026-02-05 18:11:12 +08:00 |
|
|
JohnJanandJiangyun Zhu
|
8135ee81e6
|
[feature]: support flux cache_dit (#1145)
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-02-04 22:10:04 +08:00 |
|
|
WeiQing Chen
|
ab657ce374
|
[Doc] opt doc (#1118)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-02-04 15:40:30 +08:00 |
|
|
Canlin Guo
|
f95f8e936d
|
[NPU] Update Dockerfile and docs for v0.14.0 (#671)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-02-04 15:10:50 +08:00 |
|
|
wangyuandwangyu31577
|
117d9bd122
|
[Bugfix] modify RTF use audio_e2e/audio_duration (#1157)
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
|
2026-02-04 14:07:46 +08:00 |
|
|
Yuanheng Zhao
|
0aa610d82a
|
[Doc] Fix vLLM version in user docs (#1179)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-02-04 00:00:07 +08:00 |
|
|
Alicia
|
ce1ae26084
|
[Doc]Fix - Align with repo. (#1176)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-02-03 18:11:50 +08:00 |
|
|
Rustam Khadipash
|
dc6177520e
|
[Feature] add Tensor Parallelism to LongCat-Image(-Edit) (#926)
Signed-off-by: Rustam Khadipash <16683750+hadipash@users.noreply.github.com>
|
2026-02-02 10:28:25 +00:00 |
|
|
Roger Wang
|
81774fd933
|
[Misc] Bump version to 0.14.0 (#1128)
Signed-off-by: Roger Wang <hey@rogerw.io>
|
2026-02-01 00:09:43 -08:00 |
|
|
汪志鹏andHongsheng Liu
|
0f0e94760c
|
[TeaCache]: Add Coefficient Estimation (#940)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-31 22:06:17 +13:00 |
|
|
dengyunyang
|
70a5de9dd4
|
[FEATURE] /v1/images/edit interface (#1101)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-01-31 14:13:36 +08:00 |
|
|
|
07f4c3fdd6
|
[Bugfix] fix benchmark audio timing error and add benchmark test (#1109)
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-31 10:15:26 +08:00 |
|
|
Didan DengandHongsheng Liu
|
23cf48d7bb
|
[Perf]: CFG parallel abstraction (#851)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-30 16:23:44 +00:00 |
|
|
|
2923d5a91e
|
[Feature] Support DiT Layerwise (Blockwise) CPU Offloading (#858)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-01-30 17:35:09 +08:00 |
|
|
WeiQing Chen
|
be580d5c24
|
[Misc] update wechat image (#1096)
|
2026-01-30 17:06:02 +08:00 |
|
|
|
7bfd3c069d
|
[Benchmark] Add vLLM-Omni Omni model online benchmark (#780)
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-30 11:41:09 +08:00 |
|
|
Ding Zuhao
|
0e07eb6ff9
|
[Doc][Bagel] Add BAGEL-7B-MoT documentation and edit the default stage configuration (#987)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Signed-off-by: jzz <e1583181@u.nus.edu>
|
2026-01-30 12:56:10 +13:00 |
|
|
Canlin Guo
|
c9392dff01
|
[Hardware] Support platforms and plugin system (#774)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-01-28 22:12:52 +08:00 |
|
|
|
b11d436e19
|
[Doc]Format profiling doc (#993)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-01-28 20:18:02 +08:00 |
|
|
JohnJan
|
ae96aa8a8b
|
[Model]: add FLUX.1-dev model (#853)
|
2026-01-28 16:28:57 +08:00 |
|
|
Zeyu Huang | 黃澤宇
|
d64bbde561
|
[Frontend][Model] Support batch request with refined OmniDiffusionReq… (#797)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
|
2026-01-28 16:07:42 +08:00 |
|
|
yangsonglin13
|
16be03b909
|
[Feature] Implement YuanrongConnector based on OmniConnectorBase (#716)
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com>
|
2026-01-27 20:17:02 +08:00 |
|
|
Jiangyun Zhu
|
50b44303f1
|
[diffusion] add tp for FLUX.2-klein (#973)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-01-27 08:37:25 +00:00 |
|
|
Jiangyun ZhuandHongsheng Liu
|
17e79336aa
|
[doc] add some additional information for the diffusion model support (#952)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-27 12:14:19 +08:00 |
|
|
XU MingshiandHongsheng Liu
|
1fe8e71433
|
[Diffusion][Feature] Non-Intrusive Sequence Parallelism (SP) Support for Wan2.2 (#966)
Signed-off-by: mxuax <mxuax@connect.ust.hk>
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-01-27 11:33:38 +08:00 |
|
|
|
5037af1033
|
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk>
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk>
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-01-27 10:22:40 +08:00 |
|