anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,319 Commits 235 Branches 31 Tags
776424f0de8a69fc2f5da0c4f3cf767f96855f90
Commit Graph
1082 Commits
Author SHA1 Message Date
Zhou TaichangandClaude Opus 4.8 776424f0de [Refactor][WIP] Add missing test for modelrunner (G1/N) (#5333) 
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-27 16:24:47 +08:00
xsmcccandxsmccc d688aa82fc [Model] Optimize MiniCPM-o multimodal encoder memory (#5188) 
Signed-off-by: xsmccc <247721718+xsmccc@users.noreply.github.com>
Co-authored-by: xsmccc <247721718+xsmccc@users.noreply.github.com>
 2026-07-27 15:24:51 +08:00
Zeyu Huang | 黃澤宇 eaf90d8eff [Frontend] Add midway prompt update for streaming video generation (#4652) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
 2026-07-27 14:07:43 +08:00
wjsuijlenh 1f01d05603 [Core] Session state manager for AR-diffusion world models (RFC #4480 Phase 0) (#4487) 
Signed-off-by: Wijnand Suijlen <wijnand.suijlen@huawei.com>
 2026-07-27 13:17:38 +08:00
Inesh Reddy Chappidi 9f3a73df17 test: make Qwen-Image diffusers-backend latency check fair and stable (#5108) (#5132) 
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
 2026-07-26 22:14:26 -07:00
Zheng Wengang b9b8282cf5 [BugFix] Couple audio+video mm-cache for use_audio_in_video (#5308) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
 2026-07-27 04:29:53 +00:00
Yash Jain 911ea0c586 [Bugfix][Frontend] Parse VLLM_USE_MODELSCOPE via vllm.envs (#5428) 
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com>
 2026-07-27 04:19:22 +00:00
Wallbreazzz e28e389a76 feat(qwen3-tts): add codec_chunk_ramp for gradual chunk size warmup (#5152) 
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
 2026-07-27 04:15:43 +00:00
zhumingjue138 138c6988ad [Bugfix] skip test case for #5437 (#5440) 
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
 2026-07-27 11:47:59 +08:00
汪志鹏 ccdb2b51aa [Refactor]: Intrduce x_to_text.py in examples (#5384) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-07-26 16:33:17 +08:00
y-nullamy-why-3459Hongsheng Liu
 		b6c4578dac [BugFix]Add MiniCPM-o 4.5 end-to-end test suite (offline, online serving) (#5237) 
Signed-off-by: y_null <y_null@qq.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-25 17:00:13 -07:00
boatman 76e4a78afc [Bugfix][Higgs-Audio-V3] Propagate Sampling Parameters to Sampler (#5406) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
 2026-07-25 15:25:35 +00:00
Ma1oneZhangSy03Hongsheng Liu
 		af2f84582b perf(qwen3-tts): cache decoder masks and compile pre-transformer (#5107) 
Signed-off-by: Ziyang Zhang <hafuhafu@qq.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-25 08:09:19 +00:00
Sy03 e043818abf [Bugfix][Frontend] Remove async-chunk guard from realtime API (#5383) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-07-25 09:20:47 +08:00
wangyu ff0a76e31c [CI/Bugfix] Move CI editable APP_DIR to /opt/vllm-omni for k8s package discovery (#5364) (#5368) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-24 16:34:30 +00:00
TaffyOfficialandTaffyOfficial 93786c9cd3 [perf] Add configurable diffusion compile granularity (#4603) 
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
 2026-07-24 15:22:06 +00:00
Honghan ZhuClaude Opus 4.7dengyunyang
 		84bbd57e4d [Feature] Add AllGather-KV sequence-parallel attention str… (#4968) 
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Signed-off-by: dph97 <nenbaying@163.com>
Signed-off-by: zhuhh97 <zhh@unknown>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: dengyunyang <584797741@qq.com>
 2026-07-24 14:45:26 +00:00
Yang_wdrs 8927ec057c [Refactor][1/N]diffusion/cache: cache-dit (#5226) 
Signed-off-by: yangjianjuan <66548561+yangjianjuan@users.noreply.github.com>
 2026-07-24 22:42:45 +08:00
wangyuandWeiming Liao a5d9d57adc [Refactor][CI] Unify skip-ci targeting and mirror_hardwares pipeline presets (#5254) 
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
Signed-off-by: [Your Name] [Your Email]
Co-authored-by: Weiming Liao <fayespica@outlook.com>
 2026-07-24 22:28:43 +08:00
Viacheslav Klimkov 784c27f493 [Bugfix][Core] Fix async streaming segment-stop accounting (#5183) 
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com>
 2026-07-24 19:31:47 +08:00
rein yangandSy03 ad3a162eb8 [perf] Minicpm o4.5 optimization (#5228) 
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Co-authored-by: Sy03 <1370724210@qq.com>
 2026-07-24 17:20:39 +08:00
Diya Peng acf941da4d [Diffusion] Add VAE patch parallel support for FLUX.2-dev (#5292) 
Signed-off-by: dpeng123 <diyapeng123@gmail.com>
 2026-07-24 07:00:57 +00:00
wangyu 6eed6b9434 [CI/Test] Skip realtime async_chunk WebSocket case blocked by #3907 (#5363) (#5367) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-24 10:52:24 +08:00
Joshna-MedisettyandChendi.Xue 0fe5d73a63 [Bugfix][XPU] Fix free-memory abort and num_speculative_steps crash on XPU (#5330) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
 2026-07-23 17:17:00 +00:00
ZacheryAU 4c23a3164b [Refactor] Split vllm_omni/entrypoints/cli/benchmark/serve.py (#5206) 2026-07-23 16:00:32 +00:00
ZacheryAU 778959797c [Refactor] Centralize metrics related helpers to metrics/ (#5168) 2026-07-23 15:55:05 +00:00
wangyu e9a06d5bdc [CI/Bugfix] Fix empty vllm_omni stub breaking stage CLI imports after Docker cache (#5338) (#5341) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-23 14:15:52 +00:00
wangyu f72b38184b [CI] move Krea-2 expansion to slow and skip failing README snippets (#5347) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-23 21:47:58 +08:00
Sy03lishunyang12Yueqian LinStormMelodyGao HanHongsheng Liu
 		05b794f29b [Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907) 
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: StormMelody <22371184@zju.edu.cn>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-23 16:45:18 +08:00
psv666 b55120c93b [Model][MiniCPM-o 4.5] Resolve Hugging Face model ID to local cache path in TTS (#5301) 
Signed-off-by: psv666 <2693925048@qq.com>
 2026-07-23 16:05:54 +08:00
Diya Peng b471a5cf23 [Diffusion] Add FLUX.2-dev CPU Offload (Layerwise) (#5256) 
Signed-off-by: dpeng123 <diyapeng123@gmail.com>
 2026-07-23 14:53:04 +08:00
Jack Chen 96235da468 Generalize AR-Diffusion KV session capabilities (#5271) 
Signed-off-by: Jack47 <scsvip@gmail.com>
 2026-07-23 12:37:32 +08:00
LHXuuu 00bdb5dcd7 [Perf][Ming-TTS] Cache speaker embeddings for uploaded reference audio (#5240) 
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
 2026-07-23 11:22:51 +08:00
bjf-frzandHongsheng Liu be667a8067 [Refact] Refactor diffusion output streaming (#5166) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-23 10:06:08 +08:00
Nick Cao f10320f53f [Tests] Config driven tiny model builder (#5090) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-07-22 17:11:53 +00:00
vOvandClaude Opus 4.8 cc1939120f [Bugfix] Skip non-positive scheduled token spans in omni stage runners (#5269) 
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-22 16:01:45 +00:00
汪志鹏 f44649ffd0 [Refactor]: Remove sensenova examples (#5201) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-07-22 15:36:00 +00:00
Ricardo Noriega 23d0ee5c0c [Bugfix] Return error for unsupported output modalities instead of empty choices (#4720) 
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
 2026-07-22 11:00:01 +00:00
Fyrgo道路自信amy-why-3459
 		68ee52f4e7 [Model] MiniCPM-o 4.5: optimize SigLIP position IDs (#5130) 
Signed-off-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com>
Co-authored-by: 道路自信 <182356120+daoluzixin@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-22 18:35:37 +08:00
rein yang 1984346bc7 [Refactor] [0/N] Scheduler clean dead code (#5312) 
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
 2026-07-22 17:59:44 +08:00
Yukim1 633ebbd8a4 [Refactor] Migrate Step-Audio2 online test to deploy config (#5309) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-07-22 09:44:27 +00:00
wangyu 8fc9df4331 [CI][Bugfix] remove module-level skip_if_gated_repo_inaccessible in flux kontext e2e (#5250) (#5297) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-22 17:29:59 +08:00
Zeyu Huang | 黃澤宇andHongsheng Liu 9479720f81 [Refactor]: clean up diffusion model runner surface (#5218) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-22 17:07:36 +08:00
Zeyu Huang | 黃澤宇CursorHongsheng Liu
 		f43d761c26 [Refactor]: clean up diffusion worker interfaces (#5217) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-22 17:07:09 +08:00
Mu GuanLin 39e83e27f0 [Bug][CI] Pin the LTX FP8 quality gate to its established sigma schedule (#5302) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-07-22 14:36:32 +08:00
Yifan TianandDidan Deng 24eb4ab89c [Model] Add Cache-DiT support for FLUX.1-Kontext-dev (#4205) 
Signed-off-by: yifan <Yifan.Tian@colorado.edu>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-07-22 14:06:12 +08:00
Zeyu Huang | 黃澤宇Copilot Autofix powered by AICursor
 		e39f4dddfb [Refactor]: clean up diffusion scheduler interfaces (#5216) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-22 14:05:49 +08:00
Yuekai ZhangandClaude Fable 5 e2115fb642 [Bugfix][CI] Relax higgs_audio_v2 PCM streaming HNR threshold (fixes #5045) (#5232) 
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-22 11:26:00 +08:00
Bingyu (Spencer) Liu dcf8b07d39 [Core] Cleanup Omni connector runtime and transfer backends (#5096) 
Signed-off-by: spencerr221 <liubingyu62@gmail.com>
 2026-07-22 09:44:15 +08:00
Zeyu Huang | 黃澤宇 2cf5f57b3e [Refactor]: clean up diffusion executor lifecycle (#5215) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
 2026-07-22 09:30:59 +08:00