Commit Graph
3026 Commits
Author SHA1 Message Date
nodeeeeee 909b121e0a [Qwen2.5-Omni] Avoid redundant embedding computation (#7477)
Signed-off-by: nodeeeeee <zhangkai.nodeee@gmail.com>
2026-09-14 10:02:11 -07:00
ea1a416a17 [Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084)
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-14 09:55:53 -07:00
bcsdhjew e0c4f97f32 [Bugfix][Frontend] Preserve duplex chat audio format and duration (#7316)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
2026-09-14 09:05:55 -07:00
Tai An 1b6cd282f0 fix(qwen-image): drop the shadowed dead _get_qwen_prompt_embeds duplicate (#7461)
Signed-off-by: Anai-Guo <antai12232931@outlook.com>
2026-09-14 13:48:51 +00:00
BeatSeat 3d793481a0 [Bugfix][MiniCPMO45] Return bare tensor in Thinker forward to fix repetition loop (#7497) (#7517)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
2026-09-14 21:11:15 +08:00
psv666 446c2b5474 [Bugfix] Forward Qwen3-Omni streaming video sampling parameters (#7325)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-14 19:29:50 +08:00
jiahengxie 2cbfd3e93b [Performance][MammothModa2] Enable and validate FP8 KV cache for AR stage (#7436)
Signed-off-by: JH <13716265422@139.com>
2026-09-14 00:47:39 -07:00
64903b8e30 [CI/Build] Share nightly CUDA YAML between H100/L4 and B200 (#7028)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] [Your Email]
Signed-off-by: [Your Name] <your.email@example.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-14 14:27:10 +08:00
andyluo7 58adeec05f [CI/Build] Add experimental AMD MI300 nightly lane (#6978)
Signed-off-by: andyluo7 <andy.luo@amd.com>
2026-09-14 12:02:28 +08:00
汪志鹏andClaude Opus 5 e8f45fcd89 [Frontend] Add ComfyUI FastH3 node, fix t2va aspect ratio and dropped audio (#7456)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-14 11:22:05 +08:00
WeiQing Chen db40ed3a31 [Doc] Update vLLM-Omni WeChat QR code (#7490)
Signed-off-by: David Chen <530634352@qq.com>
2026-09-14 10:54:25 +08:00
LiquidGunayandHongsheng Liu be9f3ed5c0 [CI/Build] Align CUDA release image with vLLM 0.29 (#7445)
Signed-off-by: LiquidGunay <gunaysoni@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-14 10:32:21 +08:00
Oliver7th 767cc7977e [Bugfix][NPU] Materialize causal mask in FlashAttention dense path (#7324)
Signed-off-by: Oliver7th <fangzhengyi@huawei.com>
2026-09-14 01:46:29 +00:00
8e738ce21b [P0][RFC #3747] RL rollout serving: session management + world_model_env (#4770)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
2026-09-14 09:26:44 +08:00
Lei KeandKrystalRay 6505577459 [Doc][NPU] Keep AllGather for MiniMax-H3 INT8 DLO (#7444)
Signed-off-by: KrystalRay <keeleiray@gmail.com>
Co-authored-by: KrystalRay <keeleiray@gmail.com>
2026-09-14 06:20:59 +08:00
e284d907b5 [Perf][Frontend] Chunk in-memory image file responses (#7459)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-13 20:33:10 +08:00
linzhenpl07andClaude Sonnet 5 311e714d34 [AR-Diffusion] Add session-owned streaming VAE decode (#6533)
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-13 18:17:11 +08:00
Yuan Wu 6753bbd18c [Core] Add NIXL omni connector (#6093)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Signed-off-by: Yuan Wu <yuan.wu@intel.com>
2026-09-13 16:35:02 +08:00
Hongsheng Liuandamy-why-3459 01a2f93256 [Bugfix][Frontend] Honor output_compression on the image generations route (#7447)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-13 10:05:56 +08:00
KANG Qihan f7d9deb45a [Kernel][Boogu-Image] Fuse Q/K RMSNorm + interleaved RoPE via fused_qk_norm_rope (#6982)
Signed-off-by: Qihan Kang <rollykanggg@gmail.com>
2026-09-13 09:39:27 +08:00
7e520f9cc4 [3/N] Encode streamed video on the worker with bounded batching (#7018)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:58:11 +08:00
gerayandHongsheng Liu 9edc1b4667 Optimize CosyVoice3 Stage1 flow batching (#4876)
Signed-off-by: gerayking <399geray@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:31:49 +08:00
AliciaandHongsheng Liu 28291df179 [Refactor][Diffusion] Remove model-specific names from LoRA and ModelOpt loader defaults (#5907)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:30:03 +08:00
junpengw67-maxand吴俊鹏 bc0c9f4b45 [Bugfix][Model][Lance] Support decoded video frames in video editing (#5128)
Signed-off-by: 吴俊鹏 <248679769+junpengw67-max@users.noreply.github.com>
Co-authored-by: 吴俊鹏 <248679769+junpengw67-max@users.noreply.github.com>
2026-09-12 04:23:24 +00:00
Weiming Liao b3ba67d71e [NPU] upgrade to v0.29.0 (#7433)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
2026-09-12 04:14:42 +00:00
psv666 9ef9fc442a [Bugfix] Send a downstream terminal chunk when a parked stage ends (#6889)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-12 04:10:37 +00:00
longguo 68294066e3 [Bugfix] Require a model for vllm serve --omni (fixes #4158) (#4167)
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com>
2026-09-12 04:03:16 +00:00
Guangjian Dongandamy-why-3459 4a7a8454ba [Bugfix] Give model CLI flags typed owners in the Omni config (#7390)
Signed-off-by: Guangjian <hiro20833@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-12 12:00:15 +08:00
DanaerLeeandHongsheng Liu 220366db00 [Perf][Diffusion] Run MammothModa2 DiT attention through the shared attention layer (#7094)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 11:31:05 +08:00
MaciejBalaNV 13b85c5622 [Bugfix] Add explicit error when using CFGP with distilled Cosmos3 models (#7427)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
2026-09-11 22:59:49 +00:00
Joshna-Medisetty 6fcab74aa9 [XPU][Docker] Align XPU image and CI with vLLM v0.29.0 (#7441)
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com>
2026-09-11 15:54:28 -05:00
Yueqian LinandSy03 c111f3a2d6 [Model] Add Tencent AuK speech generation and editing (encoder + diffusion pipeline) (#7385)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Sy03 <1370724210@qq.com>
2026-09-11 20:09:58 +00:00
Nick CaoandCodex d3493384cf [BugFix] Fix leftovers of the legacy OpenAI realtime API event names (#7426)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-11 22:28:55 +08:00
78e1a0ae5c [Bugfix][Model] Fix FLUX.2 Klein multi-image edit metadata (#7430)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-11 14:18:07 +00:00
GXINandHongsheng Liu 33fff2155e [Feature][TTS] Add Speech API streaming metrics (#6853)
Signed-off-by: XIN GAO <1037396230@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-11 21:22:15 +08:00
wtz2333andZhou Taichang 02aaa34059 [Model] Add LingBot World Ulysses sequence parallelism (#6841)
Signed-off-by: wtz2333 <2955110911@qq.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
2026-09-11 18:37:12 +08:00
Guangjian Dong de9a133d48 [Bugfix] Add embed_multimodal to MiniCPM-o 4.5 omni LLM class (#7384)
Signed-off-by: Guangjian <hiro20833@gmail.com>
2026-09-11 18:05:12 +08:00
andyluo7andHongsheng Liu dff8f8f4cf [CI][ROCm] Align AMD image with vLLM 0.29 (#7395)
Signed-off-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-11 17:41:45 +08:00
hyw 43b8de9b0e [Kernel][MiniMax-H3] Run Q/K RMSNorm-RoPE in one launch (#7167)
Signed-off-by: hyw <yuweih205@gmail.com>
2026-09-11 09:18:12 +00:00
hyw f62d4ad4a7 [Model][ERNIE-Image] Delay AdaLN modulation broadcast (#7171)
Signed-off-by: hyw <yuweih205@gmail.com>
2026-09-11 09:15:32 +00:00
hyw 3f7c217457 [Model] Avoid scalar synchronizations in GLM-Image preparation (#7172)
Signed-off-by: hyw <yuweih205@gmail.com>
2026-09-11 09:09:26 +00:00
a7ab91fb85 [Example] Migrate HunyuanImage-3.0 to model_extras + shared task examples (#5559)
Signed-off-by: suyanli220 <suyanli220@gmail.com>
Signed-off-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-11 16:47:25 +08:00
Samit 96360ccb00 [Perf][Diffusion] Optimize HSDP startup via Rank-0 shared weight loading and accelerated LoRA delta computation (#7005)
Signed-off-by: samithuang <285365963@qq.com>
2026-09-11 08:28:42 +00:00
Yan Caoandyancaocn bad50980c9 [Bugfix] Fix Helios USP: per-component split for correct sequence parallelism (#6930)
Signed-off-by: yancaocn <yancaochn@163.com>
Co-authored-by: yancaocn <yancaochn@163.com>
2026-09-11 11:43:34 +08:00
WeiQing Chen 3d952d1334 [Bugfix] Keep MiniMax-H3 reference audio budgets separate (#7281)
Signed-off-by: david6666666 <530634352@qq.com>
2026-09-11 09:26:35 +08:00
Jim BanandHongsheng Liu 44fed17032 [Bugfix][Core] Clean up failed HWR atomic metadata writes (#6956)
Signed-off-by: BANANASJIM <bananasjim1@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-11 09:03:26 +08:00
Nick CaoandClaude Sonnet 5 498c41b8d6 [Realtime] Emit current (non-beta) OpenAI audio/transcript event names (#7339)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-11 08:50:12 +08:00
Yueqian Lin 5c69fc2a8a [Refactor] Declare model-local KV held outside the paged manager (#6171)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-11 08:44:32 +08:00
summerandHongsheng Liu 5a386d789f [Bugfix] Fix host-memory leak on aborted /v1/images/generations (#6462) (#6561)
Signed-off-by: summer <128961079+zhang-keliang@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-11 00:04:08 +00:00
Guangjian Dong ffcaaa9439 [Bugfix] Fail when a diffusion LoRA adapter binds no layer (#7349)
Signed-off-by: Guangjian <hiro20833@gmail.com>
2026-09-10 18:45:28 +00:00