copilot-swe-agent[bot] and hsliuustc0106
b4775d52fe
Extract usage info from text output before modality filtering
...
This ensures that usage/billing data is captured even when text output
is filtered out (e.g., for audio-only requests). Previously, audio-only
requests would return zero usage tokens because the text output was
skipped before extracting usage information.
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 04:11:36 +00:00
copilot-swe-agent[bot] and hsliuustc0106
be7d524326
Fix line length linting issue
...
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 03:07:31 +00:00
copilot-swe-agent[bot] and hsliuustc0106
c7bdfb2934
Add modalities filtering to non-streaming chat completions
...
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com >
2026-01-19 03:04:26 +00:00
Gao Han
9c7de5373a
[Feature]Basic version of supporting streaming output ( #367 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-01 03:02:04 +13:00
WeiQing Chen and Hongsheng Liu
1753a878e0
[Bugfix] t2i online fix cache configuration failure and errors in /v1/images/generation endpoint. ( #499 )
...
Signed-off-by: David Chen <530634352@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-30 16:50:30 +08:00
2f69748ee4
add openai create speech endpoint ( #305 )
...
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com >
Signed-off-by: Bhanu Prakash Voutharoja <59905694+Bhanu068@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2025-12-27 13:56:51 +08:00
595e7c0032
[Core] Supports stage abstraction in the diffusion model ( #391 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-27 01:59:33 +13:00
Wonjae Lee and wonjae.lee0
341457a121
[Feature] Support standard OpenAI API sampling parameters for thinker stage. (max_tokens...) ( #450 )
...
Signed-off-by: wonjae.lee0 <wonjae.lee0@navercorp.com >
Co-authored-by: wonjae.lee0 <wonjae.lee0@navercorp.com >
2025-12-24 20:39:01 +08:00
Peiqi Yin
0e878a92d2
[BugFix] raise error when request.stream=True. ( #350 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
2025-12-23 08:52:18 +08:00
WeiQing Chen
628c0a9217
[Entrypoints] Support Qwen-Image-Edit 2509 online serving & update doc ( #368 )
...
Signed-off-by: David Chen <530634352@qq.com >
2025-12-19 16:50:32 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
Chenguang Zheng and yinpe
acf66ee2cc
[Entrypoints] Support Online Serving for Diffusion-only Models ( #259 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
2025-12-17 17:40:45 +08:00
Gao Han
8722c6374c
[Feature] Support output modalities control per request ( #298 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2025-12-17 17:19:56 +08:00
Cyrus Leung
c091a03d82
[Chore] Bump Python version and apply formatting changes for v0.12 release ( #126 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2025-12-16 15:19:40 +08:00
R2-Y and Rein
0a4e5a8710
[Feature] add support for Qwen3-omni ( #55 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein <rein@Reins-MacBook-Air.local >
2025-11-30 04:44:01 +08:00
Gao Han
598b4ddb51
[Feature] support multimodal inputs with multiple requests ( #76 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-24 16:02:44 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
