anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,090 Commits 235 Branches 31 Tags
d2bb944863b7cd7a339db4f25c9c96b26a9e67f0
Commit Graph
3090 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sy03 d2bb944863 Merge main and preserve event-driven defaults in shared engine bases 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 20:14:33 +08:00
Tianyao WuClaudeGao Hanamy-why-3459
 		fa639b889e [Bugfix] Fail a duplex session that outgrows max_model_len instead of killing the EngineCore (#7277) 
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-16 20:08:25 +08:00
RyanYun09RyanYun09amy-why-3459
 		e6cebf8557 [Bugfix][Omni-DuplexEval] Load local Hugging Face dataset layouts in duplex eval loader (#7331) 
Signed-off-by: RyanYun09 <RyanYun09@users.noreply.github.com>
Co-authored-by: RyanYun09 <RyanYun09@users.noreply.github.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-16 20:05:52 +08:00
dongbo910220 217a6af52c [Diffusion] Fuse Qwen-Image-Edit select01 modulation for CUDA (#5921) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2026-09-16 19:06:28 +08:00
dengyunyang 249e84d21b [Boogu-Image] Fuse QKV/FFN projections + switch to diffusion RMSNorm (#6649) 
Signed-off-by: dengyunyang <584797741@qq.com>
 2026-09-16 03:13:54 -07:00
H.Z afa837f15c [Frontend] Add MiniMax H3 ComfyUI text-to-video workflow (WF-01) (#7423) 
Signed-off-by: Hu <hu.zhu@connect.polyu.hk>
 2026-09-16 03:04:52 -07:00
Wu JIAZHENJaderHongsheng Liu
 		d554e6b67e [feat] Extend disaggregated MiniMax-H3 stage with VAE encoders (#6939) 
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Signed-off-by: Jader <yjader@foxmail.com>
Co-authored-by: Jader <yjader@foxmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-16 16:52:35 +08:00
Sy03 efd6709789 [Chore] Apply pre-commit formatting and SPDX headers 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 16:48:05 +08:00
Sy03 f25595e03a [Fix] Reuse resolved pipeline configuration for orchestration defaults 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 16:47:48 +08:00
Linze Shi e78a5d01f7 [Frontend] Add MiniMax-H3 references and Ref2VA workflow (#7483) 
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
 2026-09-16 08:30:16 +00:00
y-nullandamy-why-3459 5f7f62e13c [Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416) 
Signed-off-by: y_null <y_null@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-16 01:24:31 -07:00
SYLARandlishunyang12 507cb1d834 [Attention] [P1] Keep H3 VSA policy in the model and share sparse primitives (#7535) 
Signed-off-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang12@users.noreply.github.com>
 2026-09-16 15:47:31 +08:00
chickeytonandClaude Opus 5 99ff4f3070 [Core][Frontend] Unified Full-duplex Framework (#7413) 
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 15:35:36 +08:00
linzhenpl07andClaude Opus 5 9005d78903 [LingBot World] Reuse the text encode for a prompt already encoded (#6845) 
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-16 15:01:11 +08:00
Zhou Taichang 5e9024171d [Bugfix] Skip generic text-only warmup for DreamZero (#7548) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-09-16 14:43:18 +08:00
vOv 21d86ec923 [Diffusion] MAGI-2: regional compile coverage (#7174) 
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
 2026-09-16 13:01:26 +08:00
GXIN a2138b830f [Feature][Qwen3-TTS] Make Code2Wav honor the stage dtype (#6059) 
Signed-off-by: XIN GAO <1037396230@qq.com>
 2026-09-16 04:50:00 +00:00
Zheng Wengangandwuli666 275720b378 [Bugfix] Keep async video jobs queued until inference and abort on delete (#6759) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
 2026-09-15 20:43:30 -07:00
Sy03 288a707bb6 [Fix] Import trust remote code override 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 81e0b1ab17 Sign off event-driven orchestration fix 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 9eafe60cc8 [Fix] Align event-driven orchestration documentation and metrics 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 73906ed696 [Doc] Document Omni AR and TTS profiling 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 586cd1e8d5 [Core] Enable CUDA profiler for Omni workers 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 be3ab91187 [Bugfix] Keep pipeline event-driven defaults local 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 b1e10b0235 [Core] Record Event Driven dispatch queue high water 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Sy03 521ef843c6 [Perf][Qwen3-TTS] Enable event-driven orchestration by default 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 11:23:36 +08:00
Yueqian Lin 5dbae2b182 [Bugfix] Per-key accumulation strategy for Qwen3-TTS codec frame outputs (#7608) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-15 20:08:49 -07:00
psv666 7bceb1a76b [Bugfix] Align video frame consumption reporting with prompt sampling (#7329) 2026-09-16 02:49:07 +00:00
Genghong Hu 3319f6ca78 [CI/Build][Hardware][Ascend] Add torchmetrics to the NPU CI image (#7570) 
Signed-off-by: Genghong Hu <godhu777777@gmail.com>
 2026-09-16 02:37:50 +00:00
HAAZZZEEEE 3eb5c3b4e6 [Bugfix][Wan2.2] Apply UniPC flow shift once (#7576) 
Signed-off-by: HAAZZZEEEE <wang-taicheng@qq.com>
 2026-09-16 10:06:41 +08:00
tlysanhuo 2185c4e26f [Bugfix] Tolerate a bounded TTS tail in the audio-text similarity gate (#7358) 
Signed-off-by: tly <2200895168@qq.com>
 2026-09-15 18:51:49 -07:00
Deep Shah c197cd2422 [Bugfix] Fix Qwen3-Omni streaming crops in mixed-length batches (#7340) 
Signed-off-by: Deep Shah <deep@socratic.co>
 2026-09-15 18:26:43 -07:00
Clodagh Walsh a1a234a0b4 [Voxtral] Raise BadRequest for ref_audio (#7012) 
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
 2026-09-15 18:26:08 -07:00
leo 45a3e77351 [Bugfix] Route Music3 float32 attention to SDPA (#7354) 
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
 2026-09-15 18:08:06 -07:00
Weiming Liao 5527f3f407 [CI][Bugfix] Update Qwen3-TTS CI Validation Message (#7276) 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
 2026-09-15 18:07:44 -07:00
ChangXiong Denganddengchangxiong f420cfcfbf [NPU][CosyVoice3] Add CPU STFT fallback (#7520) 
Signed-off-by: dengchangxiong <dengchangxiong1@huawei.com>
Co-authored-by: dengchangxiong <dengchangxiong1@huawei.com>
 2026-09-15 18:06:41 -07:00
LOGO127 65693b30fb [Bugfix][Core] Keep sample-rate snapshots bounded in delta output (#7448) 
Signed-off-by: luozijian <luozijian0924@gmail.com>
 2026-09-15 16:50:32 -07:00
andyluo7 bbf77cce69 [CI][ROCm] Add non-blocking entrypoint GPU coverage (#7398) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-09-16 07:25:56 +08:00
yzhautouskay 6040bb97e2 [Perf][Cosmos3] Add SeaCache support for Cosmos3 (#6922) 
Signed-off-by: Yuliya Zhautouskaya <yzhautouskay@nvidia.com>
 2026-09-15 14:57:15 -07:00
Mengjie ZhaoandCursor c17126c219 [Model] Add Gepard-1.0 OpenAI /v1/audio/speech serving (#7499) 
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-15 14:56:51 -07:00
Nick CaoandCodex 78934753ff [Tests] Test image edit input limits in tiny model framework (#7434) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-15 12:36:34 -04:00
dongbo910220 952022c8ec [Diffusion][Perf] Add Qwen-Image QK RoPE Triton path (#5931) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2026-09-15 14:28:48 +00:00
wtz2333 a3dee6fdf5 [Lingbot World] Bound image condition storage and extend temporal RoPE (#6838) 
Signed-off-by: wtz2333 <2955110911@qq.com>
 2026-09-15 18:49:55 +08:00
xuexueligaoand汪志鹏 4a8ac29775 [Frontend] Add MiniMax H3 video upscale workflow (WF-07) (#7472) 
Signed-off-by: xuezhihao <89690814+xuexueligao@users.noreply.github.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-09-15 03:46:13 -07:00
andyluo7 92715f3f7b [CI][ROCm] Add non-blocking engine and model executor GPU coverage (#7397) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-09-15 13:24:34 +08:00
Deep Shah 5761ad5516 [Bugfix] Restore the async PP sampled-token broadcast in the AR runner (#7393) 
Signed-off-by: Deep Shah <deep@socratic.co>
 2026-09-14 20:41:03 -07:00
Anjie HouandClaude Opus 5 85da943391 [Refactor][Diffusion] Complete generic backend plan consumption (#7313) 
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-15 08:40:04 +08:00
Yueqian Lin 5385dda4fe [Bugfix] Use current OpenAI audio event names in duplex client metrics (#7541) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-15 08:19:21 +08:00
Alex Brooks 01f4479138 [Bugfix] Don't shutdown Engine on py_generator=True (#6334) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-14 18:33:38 -04:00
ZacheryAU f062124ba4 [Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242) 2026-09-14 15:25:59 -07:00