anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,346 Commits 235 Branches 31 Tags
009b80d686febcf683fdbc2bcdf3ad752884641e
Commit Graph
237 Commits
Author SHA1 Message Date
psv666 271d2f51e2 [Bugfix] npu omni runner alignment (#5846) 
Signed-off-by: psv666 <2693925048@qq.com>
 2026-08-06 16:07:19 +08:00
ruirui(rein) yang 4a0a481778 [CI] MiniCPM-o4.5 CI concurrency=8 OOM bugfix (#5790) 
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
 2026-08-05 11:56:21 +08:00
psv666andamy-why-3459 4ce5fcb16c [CI/Build][MiniCPM-o] Add MiniCPM-o 4.5 accuracy and performance nightly coverage (#5710) 
Signed-off-by: psv666 <2693925048@qq.com>
Signed-off-by: psv666 <150513104+psv666@users.noreply.github.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-05 00:49:14 +08:00
ruirui(rein) yangandamy-why-3459 a5eb2a9a87 [CI][MiniCPM-o]MiniCPM-o ACC PERF CI (#5575) 
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-04 18:46:20 +08:00
ZacheryAU 434c220da1 [bugfix][CI][MiniCPM-o] fix CI failure of test_audio_to_text_audio_001 in Buildkit 13077 (#5705) 2026-08-04 11:34:36 +08:00
ZacheryAUSYLARlishunyang12
 		f05babab84 [Bugfix] Use MiniCPM-o speech template in long audio test (#5623) (#5651) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-02 17:38:02 +08:00
amy-why-3459 a80d1e614d [CI][MiniCPM-o] Prefer standard omni serve over stage CLI in e2e/reli… (#5553) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-29 21:04:52 +08:00
amy-why-3459 00d796edf9 [CI][MiniCPM-o] Run e2e tests on single-GPU deploy config (#5506) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-29 19:43:31 +08:00
wangyu 0b3898c884 [CI] Point merge/nightly Buildkite triggers at minicpm-challenge (#5497) 
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
 2026-07-28 18:47:20 +08:00
Sy03 ffa9a6af69 [WIP][Bugfix][MiniCPM-o] Fix Full duplex bugs for minicpm-challenge (#5496) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-07-28 15:59:26 +08:00
Zheng Wengang b9b8282cf5 [BugFix] Couple audio+video mm-cache for use_audio_in_video (#5308) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
 2026-07-27 04:29:53 +00:00
zhumingjue138 138c6988ad [Bugfix] skip test case for #5437 (#5440) 
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
 2026-07-27 11:47:59 +08:00
y-nullamy-why-3459Hongsheng Liu
 		b6c4578dac [BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) (#5237) 
Signed-off-by: y_null <y_null@qq.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-25 17:00:13 -07:00
Ma1oneZhangSy03Hongsheng Liu
 		af2f84582b perf(qwen3-tts): cache decoder masks and compile pre-transformer (#5107) 
Signed-off-by: Ziyang Zhang <hafuhafu@qq.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-25 08:09:19 +00:00
Diya Peng acf941da4d [Diffusion] Add VAE patch parallel support for FLUX.2-dev (#5292) 
Signed-off-by: dpeng123 <diyapeng123@gmail.com>
 2026-07-24 07:00:57 +00:00
wangyu f72b38184b [CI] move Krea-2 expansion to slow and skip failing README snippets (#5347) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-23 21:47:58 +08:00
Sy03lishunyang12Yueqian LinStormMelodyGao HanHongsheng Liu
 		05b794f29b [Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907) 
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: StormMelody <22371184@zju.edu.cn>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-23 16:45:18 +08:00
Diya Peng b471a5cf23 [Diffusion] Add FLUX.2-dev CPU Offload (Layerwise) (#5256) 
Signed-off-by: dpeng123 <diyapeng123@gmail.com>
 2026-07-23 14:53:04 +08:00
Yukim1 633ebbd8a4 [Refactor] Migrate Step-Audio2 online test to deploy config (#5309) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-07-22 09:44:27 +00:00
wangyu 8fc9df4331 [CI][Bugfix] remove module-level skip_if_gated_repo_inaccessible in flux kontext e2e (#5250) (#5297) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-22 17:29:59 +08:00
Yifan TianandDidan Deng 24eb4ab89c [Model] Add Cache-DiT support for FLUX.1-Kontext-dev (#4205) 
Signed-off-by: yifan <Yifan.Tian@colorado.edu>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-07-22 14:06:12 +08:00
Yuekai ZhangandClaude Fable 5 e2115fb642 [Bugfix][CI] Relax higgs_audio_v2 PCM streaming HNR threshold (fixes #5045) (#5232) 
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 11:26:00 +08:00
JaeandCursor ee33954dff [Model] Support Boogu/Boogu-Image-0.1-Base and Boogu/Boogu-Image-0.1-Edit (#4995) 
Signed-off-by: zzehli <jaeli_ottawa@outlook.com>
Signed-off-by: jl <jaeli_ottawa@outlook.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-21 18:58:56 +00:00
wangyu 7b5b399210 [CI] skip test_audio_in_video_default_loader_sampling_regression (#5248) (#5280) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-21 21:47:55 +08:00
wtz2333andhsliuustc0106 5a6a93dc5f [diffusion][model] Add LingBot Video dense and MoE support (#5035) 
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
Signed-off-by: wtz2333 <2955110911@qq.com>
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com>
 2026-07-21 17:27:29 +08:00
zhumingjue138 4d799997d3 [Bugfix] Fix issue 5205, add trust-remote-code (#5213) 
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
 2026-07-20 15:20:53 +00:00
Shenglei Fu 7b2edd6650 [Bugfix][Qwen3-TTS] Mode-aware ref_audio artifact readiness (fixes #5049) (#5157) 2026-07-20 00:38:07 -07:00
boatmanandYueqian Lin 32dddfcef4 [Cleanup]Migrate model validation to adapters and clean up serving_speech.py (#4833) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
 2026-07-19 23:03:32 -07:00
Lancer eef3bd5c4a [Feat] support CFG Parallel for FLUX kontext (#2281) 
Signed-off-by: Lancer <maruixiang6688@gmail.com>
 2026-07-20 10:05:05 +08:00
wangyu 907f932b72 [CI][Test] Tier diffusion offloader CI and reduce gpu_4_queue merge usage and fix #5182 (#5185) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-18 17:15:17 +08:00
Ricardo Noriega 68a992060b [Bugfix] Fix audio.format parameter silently ignored in chat completions (#4718) 
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
 2026-07-16 00:17:02 -06:00
Naga Sai Abhinay Devarinti 6581e2afa9 [Model] Add Krea 2 text-to-image diffusion model (#4730) 
Signed-off-by: Abhinay1997 <devarintinagasaiabhinay@gmail.com>
 2026-07-11 16:25:41 -07:00
Zheng Wengang 9fe26cfacb [Bugfix][Model] Fix Qwen3-Omni video metadata handling for use_audio_in_video (#4959) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
 2026-07-10 14:24:18 +08:00
Alex Brooks 690864f277 [Tests] Tiny Diffusion Model Pattern (#4524) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-09 09:03:51 -06:00
Alex Brooks b7d08fe5f6 [Core / Bugfix] Add Mechanism for Endpoint Rejection (#4762) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-08 09:00:47 -06:00
herotai214 d4a869fe5e [Bugfix] Fix tokenizer config for higgs-audio-v3 test error (#4918) 
Signed-off-by: herotai214 <herotai214@gmail.com>
 2026-07-06 10:53:24 +00:00
Kotaro Kikuchi 46f10478dc [Bugfix] Qwen-Image-Layered: allow layers=2 to match upstream demo (#4777) 
Signed-off-by: Kotaro Kikuchi <ktrk115@gmail.com>
 2026-07-04 03:06:24 +00:00
ChenWenjing 720bd756bf [ci]loose voxcpm2 HNR baseline (#4801) 
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
 2026-07-02 02:19:05 +00:00
Zhou Taichang a560ed184d [Rebase] Rebase to vllm v0.24.0 (#4709) 2026-06-30 19:41:06 +08:00
Jae 0899a1a666 Migrate audiox examples (#4607) 
Signed-off-by: zzehli <jaeli_ottawa@outlook.com>
 2026-06-30 04:41:30 +00:00
faceless void 11f6a0b72e Make speech streaming default to SSE (#4679) 
Signed-off-by: syd520zy <529477025@qq.com>
 2026-06-30 02:17:24 +00:00
wangyuandHongsheng Liu 7619ed6b82 [CI] Reducing mithril-h100-pool in ready&merge CI, optimize ready CI duration (#4354) 
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: [Your Name] <[Your Email]>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-06-29 05:17:57 +00:00
bjf-frzandAlicia cd35572069 [CI]Add Cosmos3 L2 serving tests (#4535) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
 2026-06-29 09:15:17 +08:00
amy-why-3459 4024a8ccd6 [BugFix] Remove prefix-cache test cases (#4703) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-25 13:47:41 +08:00
Nick CaoandClaude 6646a66d41 [BugFix] Use ModuleDiscovery for HSDP DiT sharding to support nested pipelines (#3456) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-23 02:54:14 +00:00
BeatSeat 044240d8eb [Model] Add IndexTTS2 text-to-speech support (#3838) 
Signed-off-by: BeatSeat <wendavid552@gmail.com>
Signed-off-by: David <david@podcast.ai>
Signed-off-by: wendavid552 <wendavid552@gmail.com>
Signed-off-by: WenDavid <davidzhangcf@foxmail.com>
 2026-06-22 19:24:01 +00:00
Zhengyuan Su (苏政渊)andClaude Opus 4.8 2d0b1d8a29 [Diffusion] add GR00T-N1.7 pipeline with OpenPI serving (#3798) 
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-20 11:45:26 +08:00
amy-why-3459 f05e03aea8 [Perf][DreamZero]dreamzero supports CUDA graph, torch.compile, and DiT Caching. (#4213) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-19 14:24:37 +08:00
Nick CaoandClaude e957d16f8d [Refactor] Migrate existing pipelines to use SupportsComponentDiscovery for offload discovery (#3076) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-17 21:33:06 +08:00
akshatvishu d78a92ec54 [bugfix] Shim PreTrainedModel._tp_plan to fix MOSS-TTS-Nano load crash (#4398) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-06-17 17:17:03 +08:00