Commit Graph
3047 Commits
Author SHA1 Message Date
xuexueligaoand汪志鹏 4a8ac29775 [Frontend] Add MiniMax H3 video upscale workflow (WF-07) (#7472)
Signed-off-by: xuezhihao <89690814+xuexueligao@users.noreply.github.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
2026-09-15 03:46:13 -07:00
andyluo7 92715f3f7b [CI][ROCm] Add non-blocking engine and model executor GPU coverage (#7397)
Signed-off-by: andyluo7 <andy.luo@amd.com>
2026-09-15 13:24:34 +08:00
Deep Shah 5761ad5516 [Bugfix] Restore the async PP sampled-token broadcast in the AR runner (#7393)
Signed-off-by: Deep Shah <deep@socratic.co>
2026-09-14 20:41:03 -07:00
Anjie HouandClaude Opus 5 85da943391 [Refactor][Diffusion] Complete generic backend plan consumption (#7313)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-15 08:40:04 +08:00
Yueqian Lin 5385dda4fe [Bugfix] Use current OpenAI audio event names in duplex client metrics (#7541)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-15 08:19:21 +08:00
Alex Brooks 01f4479138 [Bugfix] Don't shutdown Engine on py_generator=True (#6334)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
2026-09-14 18:33:38 -04:00
ZacheryAU f062124ba4 [Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242) 2026-09-14 15:25:59 -07:00
Zhichao Zhang 27f0e8c1ea [Bugfix][Qwen3-TTS] Gate async-chunk Code2Wav on non_streaming_mode (#4371) (#6898)
Signed-off-by: Zhichao Zhang <60429419+smartDream-chao@users.noreply.github.com>
2026-09-14 15:25:51 -07:00
Amanandbezdarnost a22a7dd68f [Model] Add VoxCPM2 startup LoRA adapter support (#7108)
Signed-off-by: bezdarnost <urumbekovaman@gmail.com>
Co-authored-by: bezdarnost <urumbekovaman@gmail.com>
2026-09-14 15:25:42 -07:00
Tianyao WuandClaude 1b7e854b05 [Bugfix][MiniCPM-o] Attach a unit's whole frame group and size the vision slot budget like Stage0 (#7271)
Signed-off-by: Tianyao Wu <rayroy31@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-14 15:25:34 -07:00
Yash Jain 5f50fc3daf [Kernel] Fuse Ming streaming ISTFT overlap-add and normalization (#7338)
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com>
2026-09-14 15:25:25 -07:00
yulun 8e088c7725 [Hardware][Ascend][Model] Support MOSS-TTS-Nano on Ascend A2 (#7192)
Signed-off-by: Big2Wheel <1404207590@qq.com>
2026-09-14 15:25:17 -07:00
kunkun c68eadbbe0 [Performance] Optimize MammothModa2 AR → DiT hidden-state transfer (#7102)
Signed-off-by: kunkunblueberry <1833921874@qq.com>
Signed-off-by: kunkun <72174834+kunkunblueberry@users.noreply.github.com>
2026-09-14 15:25:08 -07:00
Ethan ZHUandZhu Shihao 9f85b3722e [Model] Stop MiniCPM-o Thinker at TTS boundaries (#7463)
Signed-off-by: Zhu Shihao <zhushihao@bytedance.com>
Co-authored-by: Zhu Shihao <zhushihao@bytedance.com>
2026-09-14 15:25:00 -07:00
LOGO127 7ad51f0007 [Misc][HiggsAudioV3] Diagnose skipped reference audio substitution (#7098)
Signed-off-by: luozijian <luozijian0924@gmail.com>
2026-09-14 15:24:49 -07:00
Nick CaoandCodex ed3776645d [Tests] Skip global GPU cleanup for parallel online diffusion tests (#7534)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-15 04:50:07 +08:00
Nick Cao fb23e8807a [BugFix] Fix importing renamed module vllm.entrypoints.openai.engine.… (#7531)
Signed-off-by: Nick Cao <ncao@redhat.com>
2026-09-14 13:15:27 -06:00
yadongandtanyadong 731e36fb57 [Bugfix][Hardware][Ascend] Fix Qwen3-TTS code predictor dtype and nested graph replay (#6639)
Signed-off-by: tanyadong <2209931449@qq.com>
Signed-off-by: tanyadong <yadongtan666@gmail.com>
Co-authored-by: tanyadong <2209931449@qq.com>
2026-09-14 11:43:02 -07:00
Pujitha PaladuguandPujitha Paladugu 5f25d98652 [Bugfix] Allow Fish Speech phoneme-control tokens through normalize_fish_speech_text (#7043)
Signed-off-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com>
Co-authored-by: Pujitha Paladugu <10557236+pujitha24@users.noreply.github.com>
2026-09-14 10:02:39 -07:00
heyuanliu-intel 40f8e94400 [Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047)
Signed-off-by: heyuanliu-intel <heyuan.liu@intel.com>
2026-09-14 10:02:30 -07:00
Deep Shah 2f1a18e69f [Bugfix][Qwen3-Omni] Fix synchronous Thinker pipeline parallelism (#7345)
Signed-off-by: Deep Shah <deep@socratic.co>
2026-09-14 10:02:21 -07:00
nodeeeeee 909b121e0a [Qwen2.5-Omni] Avoid redundant embedding computation (#7477)
Signed-off-by: nodeeeeee <zhangkai.nodeee@gmail.com>
2026-09-14 10:02:11 -07:00
ea1a416a17 [Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084)
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-14 09:55:53 -07:00
bcsdhjew e0c4f97f32 [Bugfix][Frontend] Preserve duplex chat audio format and duration (#7316)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
2026-09-14 09:05:55 -07:00
Tai An 1b6cd282f0 fix(qwen-image): drop the shadowed dead _get_qwen_prompt_embeds duplicate (#7461)
Signed-off-by: Anai-Guo <antai12232931@outlook.com>
2026-09-14 13:48:51 +00:00
BeatSeat 3d793481a0 [Bugfix][MiniCPMO45] Return bare tensor in Thinker forward to fix repetition loop (#7497) (#7517)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
2026-09-14 21:11:15 +08:00
psv666 446c2b5474 [Bugfix] Forward Qwen3-Omni streaming video sampling parameters (#7325)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-14 19:29:50 +08:00
jiahengxie 2cbfd3e93b [Performance][MammothModa2] Enable and validate FP8 KV cache for AR stage (#7436)
Signed-off-by: JH <13716265422@139.com>
2026-09-14 00:47:39 -07:00
64903b8e30 [CI/Build] Share nightly CUDA YAML between H100/L4 and B200 (#7028)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] [Your Email]
Signed-off-by: [Your Name] <your.email@example.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-14 14:27:10 +08:00
andyluo7 58adeec05f [CI/Build] Add experimental AMD MI300 nightly lane (#6978)
Signed-off-by: andyluo7 <andy.luo@amd.com>
2026-09-14 12:02:28 +08:00
汪志鹏andClaude Opus 5 e8f45fcd89 [Frontend] Add ComfyUI FastH3 node, fix t2va aspect ratio and dropped audio (#7456)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-14 11:22:05 +08:00
WeiQing Chen db40ed3a31 [Doc] Update vLLM-Omni WeChat QR code (#7490)
Signed-off-by: David Chen <530634352@qq.com>
2026-09-14 10:54:25 +08:00
LiquidGunayandHongsheng Liu be9f3ed5c0 [CI/Build] Align CUDA release image with vLLM 0.29 (#7445)
Signed-off-by: LiquidGunay <gunaysoni@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-14 10:32:21 +08:00
Oliver7th 767cc7977e [Bugfix][NPU] Materialize causal mask in FlashAttention dense path (#7324)
Signed-off-by: Oliver7th <fangzhengyi@huawei.com>
2026-09-14 01:46:29 +00:00
8e738ce21b [P0][RFC #3747] RL rollout serving: session management + world_model_env (#4770)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
2026-09-14 09:26:44 +08:00
Lei KeandKrystalRay 6505577459 [Doc][NPU] Keep AllGather for MiniMax-H3 INT8 DLO (#7444)
Signed-off-by: KrystalRay <keeleiray@gmail.com>
Co-authored-by: KrystalRay <keeleiray@gmail.com>
2026-09-14 06:20:59 +08:00
e284d907b5 [Perf][Frontend] Chunk in-memory image file responses (#7459)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-13 20:33:10 +08:00
linzhenpl07andClaude Sonnet 5 311e714d34 [AR-Diffusion] Add session-owned streaming VAE decode (#6533)
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-13 18:17:11 +08:00
Yuan Wu 6753bbd18c [Core] Add NIXL omni connector (#6093)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Signed-off-by: Yuan Wu <yuan.wu@intel.com>
2026-09-13 16:35:02 +08:00
Hongsheng Liuandamy-why-3459 01a2f93256 [Bugfix][Frontend] Honor output_compression on the image generations route (#7447)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-13 10:05:56 +08:00
KANG Qihan f7d9deb45a [Kernel][Boogu-Image] Fuse Q/K RMSNorm + interleaved RoPE via fused_qk_norm_rope (#6982)
Signed-off-by: Qihan Kang <rollykanggg@gmail.com>
2026-09-13 09:39:27 +08:00
7e520f9cc4 [3/N] Encode streamed video on the worker with bounded batching (#7018)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:58:11 +08:00
gerayandHongsheng Liu 9edc1b4667 Optimize CosyVoice3 Stage1 flow batching (#4876)
Signed-off-by: gerayking <399geray@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:31:49 +08:00
AliciaandHongsheng Liu 28291df179 [Refactor][Diffusion] Remove model-specific names from LoRA and ModelOpt loader defaults (#5907)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:30:03 +08:00
junpengw67-maxand吴俊鹏 bc0c9f4b45 [Bugfix][Model][Lance] Support decoded video frames in video editing (#5128)
Signed-off-by: 吴俊鹏 <248679769+junpengw67-max@users.noreply.github.com>
Co-authored-by: 吴俊鹏 <248679769+junpengw67-max@users.noreply.github.com>
2026-09-12 04:23:24 +00:00
Weiming Liao b3ba67d71e [NPU] upgrade to v0.29.0 (#7433)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
2026-09-12 04:14:42 +00:00
psv666 9ef9fc442a [Bugfix] Send a downstream terminal chunk when a parked stage ends (#6889)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-12 04:10:37 +00:00
longguo 68294066e3 [Bugfix] Require a model for vllm serve --omni (fixes #4158) (#4167)
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com>
2026-09-12 04:03:16 +00:00
Guangjian Dongandamy-why-3459 4a7a8454ba [Bugfix] Give model CLI flags typed owners in the Omni config (#7390)
Signed-off-by: Guangjian <hiro20833@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-12 12:00:15 +08:00
DanaerLeeandHongsheng Liu 220366db00 [Perf][Diffusion] Run MammothModa2 DiT attention through the shared attention layer (#7094)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 11:31:05 +08:00