anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,077 Commits 235 Branches 31 Tags
ec0feea2bd9d3bef1bbb79561ad89e15b70effeb
Commit Graph
3077 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sy03 ec0feea2bd Fix ROCm diffusion CI platform guard and startup deadlines 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 20:18:31 +08:00
Sy03 daf91b4d7a Merge main and preserve multi-API engine and duplex guards 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 16:40:16 +08:00
Linze Shi e78a5d01f7 [Frontend] Add MiniMax-H3 references and Ref2VA workflow (#7483) 
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
 2026-09-16 08:30:16 +00:00
y-nullandamy-why-3459 5f7f62e13c [Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416) 
Signed-off-by: y_null <y_null@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-16 01:24:31 -07:00
Sy03 40a000de05 Document multi-API serving tradeoffs in TTS profile 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 16:00:45 +08:00
SYLARandlishunyang12 507cb1d834 [Attention] [P1] Keep H3 VSA policy in the model and share sparse primitives (#7535) 
Signed-off-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang12@users.noreply.github.com>
 2026-09-16 15:47:31 +08:00
chickeytonandClaude Opus 5 99ff4f3070 [Core][Frontend] Unified Full-duplex Framework (#7413) 
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 15:35:36 +08:00
linzhenpl07andClaude Opus 5 9005d78903 [LingBot World] Reuse the text encode for a prompt already encoded (#6845) 
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-16 15:01:11 +08:00
Zhou Taichang 5e9024171d [Bugfix] Skip generic text-only warmup for DreamZero (#7548) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-09-16 14:43:18 +08:00
vOv 21d86ec923 [Diffusion] MAGI-2: regional compile coverage (#7174) 
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
 2026-09-16 13:01:26 +08:00
GXIN a2138b830f [Feature][Qwen3-TTS] Make Code2Wav honor the stage dtype (#6059) 
Signed-off-by: XIN GAO <1037396230@qq.com>
 2026-09-16 04:50:00 +00:00
Sy03 dc3c7dbe16 Rebase multi-API serving on latest main 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-16 12:13:04 +08:00
Zheng Wengangandwuli666 275720b378 [Bugfix] Keep async video jobs queued until inference and abort on delete (#6759) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
 2026-09-15 20:43:30 -07:00
Yueqian Lin 5dbae2b182 [Bugfix] Per-key accumulation strategy for Qwen3-TTS codec frame outputs (#7608) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-15 20:08:49 -07:00
psv666 7bceb1a76b [Bugfix] Align video frame consumption reporting with prompt sampling (#7329) 2026-09-16 02:49:07 +00:00
Genghong Hu 3319f6ca78 [CI/Build][Hardware][Ascend] Add torchmetrics to the NPU CI image (#7570) 
Signed-off-by: Genghong Hu <godhu777777@gmail.com>
 2026-09-16 02:37:50 +00:00
HAAZZZEEEE 3eb5c3b4e6 [Bugfix][Wan2.2] Apply UniPC flow shift once (#7576) 
Signed-off-by: HAAZZZEEEE <wang-taicheng@qq.com>
 2026-09-16 10:06:41 +08:00
tlysanhuo 2185c4e26f [Bugfix] Tolerate a bounded TTS tail in the audio-text similarity gate (#7358) 
Signed-off-by: tly <2200895168@qq.com>
 2026-09-15 18:51:49 -07:00
Deep Shah c197cd2422 [Bugfix] Fix Qwen3-Omni streaming crops in mixed-length batches (#7340) 
Signed-off-by: Deep Shah <deep@socratic.co>
 2026-09-15 18:26:43 -07:00
Clodagh Walsh a1a234a0b4 [Voxtral] Raise BadRequest for ref_audio (#7012) 
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
 2026-09-15 18:26:08 -07:00
leo 45a3e77351 [Bugfix] Route Music3 float32 attention to SDPA (#7354) 
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>
 2026-09-15 18:08:06 -07:00
Weiming Liao 5527f3f407 [CI][Bugfix] Update Qwen3-TTS CI Validation Message (#7276) 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
 2026-09-15 18:07:44 -07:00
ChangXiong Denganddengchangxiong f420cfcfbf [NPU][CosyVoice3] Add CPU STFT fallback (#7520) 
Signed-off-by: dengchangxiong <dengchangxiong1@huawei.com>
Co-authored-by: dengchangxiong <dengchangxiong1@huawei.com>
 2026-09-15 18:06:41 -07:00
LOGO127 65693b30fb [Bugfix][Core] Keep sample-rate snapshots bounded in delta output (#7448) 
Signed-off-by: luozijian <luozijian0924@gmail.com>
 2026-09-15 16:50:32 -07:00
andyluo7 bbf77cce69 [CI][ROCm] Add non-blocking entrypoint GPU coverage (#7398) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-09-16 07:25:56 +08:00
yzhautouskay 6040bb97e2 [Perf][Cosmos3] Add SeaCache support for Cosmos3 (#6922) 
Signed-off-by: Yuliya Zhautouskaya <yzhautouskay@nvidia.com>
 2026-09-15 14:57:15 -07:00
Mengjie ZhaoandCursor c17126c219 [Model] Add Gepard-1.0 OpenAI /v1/audio/speech serving (#7499) 
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-15 14:56:51 -07:00
Nick CaoandCodex 78934753ff [Tests] Test image edit input limits in tiny model framework (#7434) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-15 12:36:34 -04:00
dongbo910220 952022c8ec [Diffusion][Perf] Add Qwen-Image QK RoPE Triton path (#5931) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2026-09-15 14:28:48 +00:00
wtz2333 a3dee6fdf5 [Lingbot World] Bound image condition storage and extend temporal RoPE (#6838) 
Signed-off-by: wtz2333 <2955110911@qq.com>
 2026-09-15 18:49:55 +08:00
xuexueligaoand汪志鹏 4a8ac29775 [Frontend] Add MiniMax H3 video upscale workflow (WF-07) (#7472) 
Signed-off-by: xuezhihao <89690814+xuexueligao@users.noreply.github.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-09-15 03:46:13 -07:00
andyluo7 92715f3f7b [CI][ROCm] Add non-blocking engine and model executor GPU coverage (#7397) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-09-15 13:24:34 +08:00
Deep Shah 5761ad5516 [Bugfix] Restore the async PP sampled-token broadcast in the AR runner (#7393) 
Signed-off-by: Deep Shah <deep@socratic.co>
 2026-09-14 20:41:03 -07:00
Anjie HouandClaude Opus 5 85da943391 [Refactor][Diffusion] Complete generic backend plan consumption (#7313) 
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-15 08:40:04 +08:00
Yueqian Lin 5385dda4fe [Bugfix] Use current OpenAI audio event names in duplex client metrics (#7541) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-15 08:19:21 +08:00
Alex Brooks 01f4479138 [Bugfix] Don't shutdown Engine on py_generator=True (#6334) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-09-14 18:33:38 -04:00
ZacheryAU f062124ba4 [Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242) 2026-09-14 15:25:59 -07:00
Zhichao Zhang 27f0e8c1ea [Bugfix][Qwen3-TTS] Gate async-chunk Code2Wav on non_streaming_mode (#4371) (#6898) 
Signed-off-by: Zhichao Zhang <60429419+smartDream-chao@users.noreply.github.com>
 2026-09-14 15:25:51 -07:00
Amanandbezdarnost a22a7dd68f [Model] Add VoxCPM2 startup LoRA adapter support (#7108) 
Signed-off-by: bezdarnost <urumbekovaman@gmail.com>
Co-authored-by: bezdarnost <urumbekovaman@gmail.com>
 2026-09-14 15:25:42 -07:00
Tianyao WuandClaude 1b7e854b05 [Bugfix][MiniCPM-o] Attach a unit's whole frame group and size the vision slot budget like Stage0 (#7271) 
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-09-14 15:25:34 -07:00
Yash Jain 5f50fc3daf [Kernel] Fuse Ming streaming ISTFT overlap-add and normalization (#7338) 
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com>
 2026-09-14 15:25:25 -07:00
yulun 8e088c7725 [Hardware][Ascend][Model] Support MOSS-TTS-Nano on Ascend A2 (#7192) 
Signed-off-by: Big2Wheel <1404207590@qq.com>
 2026-09-14 15:25:17 -07:00
kunkun c68eadbbe0 [Performance] Optimize MammothModa2 AR → DiT hidden-state transfer (#7102) 
Signed-off-by: kunkunblueberry <1833921874@qq.com>
Signed-off-by: kunkun <72174834+kunkunblueberry@users.noreply.github.com>
 2026-09-14 15:25:08 -07:00
Ethan ZHUandZhu Shihao 9f85b3722e [Model] Stop MiniCPM-o Thinker at TTS boundaries (#7463) 
Signed-off-by: Zhu Shihao <zhushihao@bytedance.com>
Co-authored-by: Zhu Shihao <zhushihao@bytedance.com>
 2026-09-14 15:25:00 -07:00
LOGO127 7ad51f0007 [Misc][HiggsAudioV3] Diagnose skipped reference audio substitution (#7098) 
Signed-off-by: luozijian <luozijian0924@gmail.com>
 2026-09-14 15:24:49 -07:00
Nick CaoandCodex ed3776645d [Tests] Skip global GPU cleanup for parallel online diffusion tests (#7534) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-15 04:50:07 +08:00
Nick Cao fb23e8807a [BugFix] Fix importing renamed module vllm.entrypoints.openai.engine.… (#7531) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-09-14 13:15:27 -06:00
yadongandtanyadong 731e36fb57 [Bugfix][Hardware][Ascend] Fix Qwen3-TTS code predictor dtype and nested graph replay (#6639) 
Signed-off-by: tanyadong <2209931449@qq.com>
Signed-off-by: tanyadong <yadongtan666@gmail.com>
Co-authored-by: tanyadong <2209931449@qq.com>
 2026-09-14 11:43:02 -07:00
Pujitha PaladuguandPujitha Paladugu 5f25d98652 [Bugfix] Allow Fish Speech phoneme-control tokens through normalize_fish_speech_text (#7043) 
Signed-off-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com>
Co-authored-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com>
 2026-09-14 10:02:39 -07:00
heyuanliu-intel 40f8e94400 [Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047) 
Signed-off-by: heyuanliu-intel <heyuan.liu@intel.com>
 2026-09-14 10:02:30 -07:00