anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,461 Commits 235 Branches 31 Tags
8484d85d1f78bf9e9002af879d0a47849957cadf
Commit Graph
65 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alex Brooks 8484d85d1f [Bugfix] Fix Sender Address Propagation (#8599)
Build Wheel / build (3.12) (push) Failing after 1m16s
Details
Build Wheel / build (3.11) (push) Failing after 1m17s
Details
pre-commit / pre-commit (push) Failing after 59s
Details 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-10-07 15:04:01 -06:00
Alex Brooks f3743ebdb6 [Bugfix] Fix In Place Compile Overwrites for Qwen3Omni Embeddings with TP > 1 (#8532) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-10-07 17:01:45 +00:00
Alex Brooks 764a109f66 [Config] Disable Async Chunk for Unsupported Pipelines (#5099) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-29 09:52:09 -06:00
Alex Brooks 6bda549ac2 [Bugfix] Fix Parallel State Initialization For MoE + Diffusion (#7676) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-17 17:15:37 -06:00
Alex Brooks 8c3d3407d1 [CI] Fix Structured Structured Diffusion Config Wan Test (#7707) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-17 00:01:01 -07:00
Alex Brooks 01f4479138 [Bugfix] Don't shutdown Engine on py_generator=True (#6334) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-14 18:33:38 -04:00
Alex Brooks a65e89cbd4 [Core] Validate PipelineConfig in __post_init__ (#6829) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-01 11:17:57 +08:00
Alex Brooks 58cb8de68b [CI] Fix Speech CI Validation Messages (#6827) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-31 08:13:59 +00:00
Alex Brooks 0eb47b76d0 [Bugfix] Handle DoS Overflow Cases (#6598) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-25 16:09:03 +00:00
Alex Brooks b4b907e7b6 [Bugfix | Model] Fix SenseNova & Use Well-defined Model Configs (#5877) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-18 16:43:05 +00:00
Alex Brooks fe54ecc388 [Frontend] Loosen Validation for TTS Models with No Uploaded Speakers (#5878) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-14 17:05:11 -06:00
Alex Brooks f7a5146093 [Feat/Bugfix] Fix API Server model tag <-> model sync & flag normalization (#3805) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-14 19:13:00 +00:00
Alex Brooks b15d4e6a64 [Frontend] Implement Batched Chat Completions (#5317) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-07 16:12:09 -06:00
Alex Brooks 089bb88706 [Model] Remove Text Encoder Output Layer Hardcoding in Flux2 (#5589) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-30 09:55:42 +00:00
Alex BrooksdougbtvClaude Opus 4.6
 		7d5376f215 [CI/Perf] Optimize Docker Caching (#5133) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: Doug Smith <dougbtv@gmail.com>
Co-authored-by: dougbtv <dosmith@redhat.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-07-22 19:14:55 -06:00
Alex Brooks c23dbfe111 [CI/Build] Add Precommit Hooks for Catching Missing PytestMarks (#4953) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-19 06:03:07 +00:00
Alex Brooks 9014bb9917 [CI] Fix core_model Level for non-Diffusion Models (#5008) 2026-07-12 03:00:50 +00:00
Alex Brooks 690864f277 [Tests] Tiny Diffusion Model Pattern (#4524) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-09 09:03:51 -06:00
Alex Brooks b7d08fe5f6 [Core / Bugfix] Add Mechanism for Endpoint Rejection (#4762) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-08 09:00:47 -06:00
Alex Brooks 5c51782c6b [Bugfix] Realign Serving Tokenization Name to Fix Error Handling Routes (#4816) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-07-02 15:23:35 +08:00
Alex BrooksandDidan Deng d526dc93e8 [Fix]: Set .transformer on SenseNova pipeline, warn if no .transformer in CacheDiT summary (#4326) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-07-01 17:40:07 +00:00
Alex Brooks 465f1464d2 [Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager (#3760) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-24 11:02:29 +08:00
Alex Brooksand汪志鹏 7ff11d8d0f [Perf/Fix] Reimplement Batched CFG Forward for Bagel (#4098) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-06-22 07:37:21 +08:00
Alex Brooks 6ff246bf3c [Cache Refactor 1/N] Simplify CacheDiT Integration (#2527) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-20 08:30:44 +08:00
Alex Brooks 7dcbeaea03 [Core] Cleanup DiffusersPipelineLoader (#1932) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-09 11:55:32 +08:00
Alex Brooks e10aca30ec [CI] Update Bagel Pixels (#4081) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-04 10:37:34 +00:00
Alex Brooks 12e75c6618 [Core] Integrate TrackingArgumentParser (#3369) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-06-02 21:56:24 +08:00
Alex BrooksandHongsheng Liu 8d13b54383 [CI/Bugfix] Async Request ID Aliasing (#3953) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-30 16:59:42 +08:00
Alex Brooks 68a1d23e4d [Bugfix/Feature] Remove Hardcoded Flash Attention in Bagel & Support GQA in SDPA Backend (#3728) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-29 10:36:15 +08:00
Alex Brooks cc0e15ba57 [Bugfix] Fix LTX2 CacheDiT Integration (#3621) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-24 21:55:34 +08:00
Alex Brooks 23e243378f [Bugfix] Set separate CFG flag in Helios for CacheDiT (#3756) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-22 19:56:41 +08:00
Alex BrooksSYLARHongsheng Liu
 		9c5e35f485 [Config Refactor] Support Recursive Merging for Engine Args (#3009) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-17 07:33:03 +08:00
Alex Brooks 754d2e52fc [BugFix] Refresh TeaCache when num_inference_steps=None (#2240) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-13 20:20:18 +00:00
Alex BrooksandGao Han ce8a7dfd2d [Bugfix] Fix Dtype Crashes in SD3 (#2526) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-05-08 16:05:38 +08:00
Alex Brooks bb239fa949 [Core] Support Async & Sync AutoRegressive Scheduling (#3306) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-05 12:09:45 +08:00
Alex Brooks e1b30061b6 [CI] Use Logprobs Check for Flaky Prefix Cache Test (#3199) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-05 00:55:54 +08:00
Alex Brooks 33586d845c [Bugfix] Use get_open_ports_list for stage ports in OmniMasterServer (#3333) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-04 05:50:31 +00:00
Alex Brooks 6a837849dd [CI] Fix Bad TP Initialization in Dynin-Omni Tests (#3298) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-03 08:02:47 +08:00
Alex Brooks e403acda3f [Minor] Move FA Imports & Fix Import Check (#3307) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-02 08:34:29 +00:00
Alex Brooks 68a484589d [CI] Add vLLM FA to Flash Attention Selection (Bagel H100 Failures) (#3302) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-05-02 07:40:05 +08:00
Alex BrooksandSYLAR bede8e02d8 [Misc] Remove Entrypoint Hijack for vLLM / 0.20.0 Changes (#3082) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
 2026-04-30 12:00:21 +00:00
Alex BrooksSy03Yueqian LinYueqian Lin
 		e03ab82dd2 [Refactor/Bugfix] Use Delta Messages for Streaming (#2911) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
 2026-04-26 15:11:53 +12:00
Alex Brooks 52c9ce2dac [CI] Fix Seed TTS Simple Unit Tests (#3126) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-25 10:21:49 +08:00
Alex Brooks 77e8ba0a7b [Bugfix] Fix Flux2klein Text Input Processing (#3098) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-24 19:54:41 +08:00
Alex Brooks 9ebfbf9fde [CI] Re-enable Prefix Cache Test (#2869) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-24 12:58:25 +08:00
Alex Brooks f346f2fdc6 Add Teacache Support for LongCat Image (#1487) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-18 07:52:35 +08:00
Alex BrooksandDidan Deng 536f59b560 [Bugfix] Fix cache dit for Longcat & LTX2 (#2860) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-04-17 20:18:00 +08:00
Alex Brooksandlengrongfu 6c57ab7ac2 [Misc] Warn When vLLM / vLLM-Omni Have Mismatched Versions (#2691) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: lengrongfu <lenronfu@gmail.com>
 2026-04-17 20:15:16 +08:00
Alex Brooks d463978098 [Model] Support Flux1 Schnell (#2528) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-17 16:02:30 +08:00
Alex Brooks f1e3f03726 [feature] Hidden State Prefix Caching (#2164) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-15 17:01:45 +00:00
Alex Brooks cf1fcd5acf [CI/BugFix] Fix Flaky Test for Qwen Omni Perf (#2754) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-14 20:49:57 +08:00
Alex BrooksandSYLAR ef230ac720 [Bugfix] Fix Incompatible Multihook Integration (TeaCache <-> CPU Offload) (#2689) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
 2026-04-12 21:44:06 +08:00
Alex Brooks 08e2e1fc8e [Bugfix] Fix DataType Handling in Default Diffusion Config (#2530) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-07 11:24:19 +08:00
Alex Brooks 10db95f9a9 [Bugfix] Fix Flux2 Dev Guidance (#2433) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-04-04 00:05:19 +08:00
Alex BrooksandSYLAR c09b039f37 [BugFix] Make Stage Device Initialization Respect Visible GPUs (#2025) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
 2026-03-25 17:56:13 +08:00
Alex Brooks 648a0b81a1 [CI/Build] Fix Doc 404s (#2155) 2026-03-25 00:52:51 +00:00
Alex Brooks a8f1394699 [Core] Simplify OmniModelConfig Initialization (#1768) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-03-22 18:27:28 +08:00
Alex Brooks a5574a2fb0 [CI] Add Flux2 Klein Tests (#2027) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-03-22 13:05:18 +08:00
Alex Brooks e17130090c [BugFix] Fix Max Rank Handling in LoRA (#1397) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-03-14 02:42:54 +00:00
Alex BrooksandDidan Deng c8cf8a799d [Refactor] Use SP Plan for LongCat Sequence Parallelism (#1772) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-03-13 11:13:34 +08:00
Alex Brooks fa944bd8e8 [BugFix] Fix LongCat Sequence Parallelism / Small Cleanup (#1631) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-03-05 17:31:00 +08:00
Alex BrooksandCanlin Guo 11a5842bd1 [Bugfix] Fix Dtype Parsing (#1391) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
 2026-03-04 22:49:28 +08:00
Alex BrooksandSYLAR a09b6499f8 [Bugfix][Model] Fix LongCat Image Config Handling / Layer Creation (#1485) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
 2026-03-03 00:50:08 +08:00
Alex Brooks bc26de834e [Bugfix] Fix LoRA Scaling on Active Adapters (#1421) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-02-26 17:22:35 +08:00
Alex Brooks 5295f0f81b [Bugfix] Fix Hardcoded Datatypes in Z-image (#1393) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-02-20 06:55:24 +00:00