tzhouam
efda9369a8
refactor: reduce copied vLLM 0.29 compatibility code
...
Reuse upstream weight mapping and multimodal processing, consolidate Omni processor bridges, and trim unused Hunyuan internals. Route no-media kwargs through the active renderer and preserve GLM generation prompt formatting.
Validation: 453 CPU tests passed, 7 skipped; processor imports, Ruff, and diff checks passed. GPU and end-to-end CI not rerun.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
87a1fd8da2
rebase: adapt to vLLM v0.29 APIs
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:52 +08:00
ZacheryAU
b1ec136bd7
[Frontend] Add omni benchmark support for image and video endpoints ( #4728 )
2026-09-08 09:28:21 +08:00
akshatvishu
f321cdbe16
[Bugfix] Use Seed-TTS reference audio with MiniCPM-o 4.5 ( #6628 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-31 10:27:34 +08:00
Zhou Taichang and Claude Opus 5
651b03225b
[Rebase] Rebase to vllm 0.28.0 ( #6606 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-27 06:12:55 +00:00
wangyu
1e2a6446f7
[CI] Remove AudioX and MammothModa2 support ( #6353 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-08-23 04:22:05 +00:00
Ian Eaves
5730af0a95
[Bugfix] Preserve prompt token usage details ( #5181 )
...
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com >
2026-08-20 20:05:05 +00:00
Yukim1
6f55a06fab
[Docs] Remove stale stage config references ( #6270 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
2026-08-20 07:09:12 +08:00
Doug Smith
07ceb3324a
[BugFix][TTS] Move user input from INFO to DEBUG in TTS/audio log lines ( #6329 )
2026-08-18 16:22:11 -06:00
fcf1085395
[Refactor][OutputProcessor 2/8]: OmniRequestOutput should inherit RequestOutput and no nested wrap-up ( #5146 )
...
Signed-off-by: Boao Shi <aoibosh@connect.hku.hk >
Signed-off-by: bowieshi <aoibosh@connect.hku.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Shi Boao Bowie <aoibosh@connect.hku.hk >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: ruirui(rein) yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-12 22:58:23 +08:00
Sy03 and Yueqian Lin
58007c0084
[New Model] Support IndexTTS 2.5 ( #5957 )
...
Signed-off-by: Sysy <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-11 23:00:35 +00:00
Zhou Taichang and Claude Opus 5
2ce15ab7a0
[Rebase] Rebase to vllm 0.27.0 ( #5976 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-11 15:23:46 +00:00
c588208cc6
[bugfix] Support lora request for non diffusion model ( #5374 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-10 11:27:51 +08:00
Mu GuanLin
d8c35663b4
[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT ( #5853 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-08-07 09:07:23 +00:00
akshatvishu
cd5daaea6a
[BugFix][Metrics] Fix per-stage time and token stats in metrics API ( #4974 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-01 03:54:17 +00:00
TaffyOfficial and TaffyOfficial
0c88f8a0b6
[Refactor] Normalize diffusion request extra arguments in Chat serving ( #5171 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-07-30 07:08:12 +00:00
b6c4578dac
[BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) ( #5237 )
...
Signed-off-by: y_null <y_null@qq.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-25 17:00:13 -07:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
Ricardo Noriega
23d0ee5c0c
[Bugfix] Return error for unsupported output modalities instead of empty choices ( #4720 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
2026-07-22 11:00:01 +00:00
Juan Pablo Zuluaga and Yueqian Lin
dacb8e6f10
[Bugfix][Perf] mimo_audio: fix per-request speech-code routing under continuous batching ( #5070 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-20 17:22:45 +00:00
Ricardo Noriega
68a992060b
[Bugfix] Fix audio.format parameter silently ignored in chat completions ( #4718 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
2026-07-16 00:17:02 -06:00
bjf-frz
1a4a042a83
[REFACT]Refactor diffusion outputs to payload metadata ( #4922 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
2026-07-14 17:24:03 +08:00
Zhou Taichang and Claude Opus 4.8
d3c47efc4f
[Rebase] Rebase to vllm v0.25.0 ( #5042 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-12 23:39:53 +08:00
Zhou Taichang
a560ed184d
[Rebase] Rebase to vllm v0.24.0 ( #4709 )
2026-06-30 19:41:06 +08:00
Yuanheng Zhao
fb3abb38fb
[refactor] Flatten Ming-flash-omni-2.0 imagegen args ( #4587 )
...
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com >
2026-06-24 17:01:58 +08:00
+2
ec4ec0f604
Add SSE stream_format support for audio speech streaming ( #4490 )
...
Signed-off-by: syd520zy <529477025@qq.com >
Signed-off-by: faceless void <100186390+syd520zy@users.noreply.github.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Signed-off-by: kTorp <Kristoffer.Torp@amd.com >
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: Hyoseop Song <crad_on25@naver.com >
Signed-off-by: Hyoseop Song <crad_on25@naver.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Chendi.Xue <chendi.xue@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Kristoffer <kristoffer.torp@amd.com >
Co-authored-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Hyoseop Song <crad_on25@naver.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-22 06:42:25 +00:00
rein yang
afbcc51672
[Model] Aura support - Non async chunk path ( #4257 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
2026-06-21 22:08:26 +08:00
f75c437a60
[Refactor]Base class for dit pipelines with unified parameter declaration[1/N] ( #4225 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-06-18 17:14:18 +08:00
Hongsheng Liu
aff0af9754
[Refactor] Extract diffusion output formatting boundary ( #4407 )
...
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-06-15 22:50:50 +08:00
Zhou Taichang
7b837944a1
[Rebase] Rebase to vllm 0.23.0 ( #4286 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-06-13 16:43:02 +00:00
MaciejBalaNV and Hongsheng Liu
03cc888485
[refactor] Refactor guardrail error handling - add 400 error code ( #4297 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-11 21:09:24 +00:00
amy-why-3459
fc7393e485
[Refactor]Refactoring audio_in_video implementation ( #3566 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-08 14:14:02 +08:00
Yaegaki1Erika and reandeng
84569280b1
[Bugfix]Fix HunyuanImage3 conditional image and prompt kwargs alignment ( #4145 )
...
Signed-off-by: reandeng <reandeng@tencent.com >
Signed-off-by: Yaegaki1Erika <70182590+Yaegaki1Erika@users.noreply.github.com >
Co-authored-by: reandeng <reandeng@tencent.com >
2026-06-05 12:47:25 +08:00
ZacheryAU
bfc7cedcf1
Benchmark data statistics for each stage of omni models ( #3628 )
...
Signed-off-by: ZacheryAU <70869627+ZacheryAU@users.noreply.github.com >
2026-06-04 21:43:35 +08:00
07737e6c61
[Test] Add prefix caching + audio output regression test ( #3510 ) ( #3604 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
2026-06-03 09:17:53 +00:00
bc794e625f
Add Cosmos3 model support ( #3454 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
Signed-off-by: MaciejBalaNV <mbala@nvidia.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: lishunyang12 <lishunyang12@163.com >
2026-06-02 04:04:31 +08:00
8d83fb59e9
[BugFix] Fix two stop reason for multimodal output ( #3374 )
...
Signed-off-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Signed-off-by: Mike Qiu <qdy220091330@gmail.com >
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-01 21:51:29 +08:00
LHXuuu and vraiti
41a795b5d6
[Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:* ( #3576 )
...
Signed-off-by: vraiti <vraiti@redhat.com >
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: vraiti <vraiti@redhat.com >
2026-06-01 20:20:48 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
zzh
ffd9771c54
Fix hunyuan resolve stop token ids ( #3896 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-05-31 07:47:36 +08:00
a698269e47
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage ( #2875 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-05-27 23:21:20 +08:00
TaffyOfficial and TaffyOfficial
3c48257f8d
[Feat][HunyuanImage3] Stream AR text for IT2I image edits ( #3723 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-05-27 12:27:11 +12:00
skf
90ed618b5a
[Bugfix] Align Offline and Online Inference ( #3506 )
2026-05-22 16:08:04 +08:00
0da9ffdb0d
Fix output finish reason issue for audio chunk in stream mode ( #2849 )
...
Signed-off-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-17 23:05:34 +08:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
dengyunyang and Hongsheng Liu
0d91fbbbb7
[Bugfix] Align the AR and DiT prompt formatting across both online and offline modes. ( #3516 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 12:13:30 +08:00
汪志鹏
c9a8556c24
[New Model]: Add sensenova u1 support ( #3319 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-05-11 22:19:00 +08:00
dengyunyang
3bf4f2850c
[Bug][Hunyuanimage 3.0] fix different AR encode behavior between online and offline ( #3500 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-05-11 11:34:58 +00:00
skf
039a09a8e1
[Feature] online HunyuanImage-3.0 IT2I (image editing) support ( #3410 )
...
Signed-off-by: skf1999 <13234016272@163.com >
2026-05-08 21:33:53 +08:00