lishunyang12
c15f51a2f6
Merge branch 'main' into lance-model-support; drop lance.yaml
...
Resolves conflicts in:
- vllm_omni/diffusion/registry.py: keep both LancePipeline (HEAD)
and MingImagePipeline (main) entries.
- vllm_omni/diffusion/models/bagel/bagel_transformer.py: take main's
simpler cfg_batched payload; HEAD referenced undefined locals.
Also strips vllm_omni/deploy/lance.yaml -- Lance is single-stage
diffusion, so its engine knobs (pipeline=lance, enforce_eager,
trust_remote_code, max_num_seqs=1, ...) flow directly to Omni(...)
/ vllm-omni serve instead of through a deploy YAML.
create_default_diffusion builds the stage config from those kwargs.
Touched: examples/offline_inference/lance/{end2end,gradio_demo}.py,
tests/e2e/online_serving/test_lance.py, tests/helpers/stage_config.py.
Signed-off-by: lishunyang12 <lishunyang12@163.com >
2026-05-31 11:50:21 +00:00
ChenWenjing
5dfdf584dd
[Feat]audio streaming input for async chunk ( #3614 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-05-31 17:39:25 +08:00
Haco and zzhuoxin1508
74050cdacd
[BugFix] Fix diffusion parallel_config YAML override and add deploy config field allowlist ( #3483 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: zzhuoxin1508 <zzhuoxin1508@users.noreply.github.com >
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
2026-05-31 08:58:52 +00:00
Canlin Guo
412bf42a75
[Refactor] Unify _talker_mtp_forward across GPU and NPU model runners ( #3476 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-31 07:58:00 +08:00
zzh
ffd9771c54
Fix hunyuan resolve stop token ids ( #3896 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-05-31 07:47:36 +08:00
WeiQing Chen
2289478e3a
[CI] Temporarily skip failing Bagel connector tests ( #4005 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-05-30 17:46:29 +08:00
Alex Brooks and Hongsheng Liu
8d13b54383
[CI/Bugfix] Async Request ID Aliasing ( #3953 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-30 16:59:42 +08:00
wuhang and Alicia
802a6242f0
[Bugfix][Tests] Remove unnecessary device map in tests init ( #3958 )
...
Signed-off-by: WU Hang <whlbx@hotmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-05-30 16:18:48 +08:00
Yuanheng Zhao and Zheng Wengang
ea6d811b58
[Config Refactor] Migrate Ming-flash-omni-2.0 Image-Gen deploy configs ( #3975 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
2026-05-30 08:13:21 +00:00
Viacheslav Klimkov and Yueqian Lin
914e92cf80
[Refactor][Qwen3-TTS] Extract reusable prompt-embeds builder and make tts_pad_embed a persistent buffer ( #3992 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-30 16:11:00 +08:00
dengyunyang
3b317285c4
[HunyuanImage][Perf] adapt to deploy config changes ( #3996 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-05-30 14:48:50 +08:00
WeiQing Chen
a3456752c5
[Diffusion] Support USP and VAE patch parallel for HunyuanVideo 1.5 ( #3979 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-30 14:40:42 +08:00
Chendi.Xue
f43bb124bc
[CI][XPU]Fix sage_attn hard-code import for cuda ( #3994 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
2026-05-30 09:43:14 +08:00
fywc
272e626100
[Feat] support cache-dit for SenseNova-U1 ( #3906 )
...
Signed-off-by: hanzheli <hanzheli@kuaishou.com >
2026-05-29 17:40:54 +00:00
knlnguyen1802 and Samit
5377108438
[minor, fix] Allow passing class interface as custom pipeline argument ( #2973 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-05-29 23:39:38 +08:00
nperraud
9fdb3bcb89
[Bugfix][Model] Qwen3-TTS: don't collapse 2D ref_code list when estimating prompt length ( #3940 )
...
Signed-off-by: nperraud <nathanael.perraudin@gmail.com >
2026-05-29 09:18:25 -06:00
b690a10e3a
[Feat] Support MagCache ( #1287 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-29 22:26:23 +08:00
WeiQing Chen
67bb9b4a12
[CI][Bugfix] Fix LTX audio-video warmup output typing ( #3964 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-29 07:46:02 +00:00
boatman and sphinxkkkbc
4d9262a6eb
[Feat]Support voice clone for omnivoice in online serving & add seed parameter for reproducible ( #3668 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-29 07:42:08 +00:00
c69ed4037d
[feat] Support prompt embedding caching for diffusion model ( #2962 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-29 15:36:03 +08:00
Alex Brooks
68a1d23e4d
[Bugfix/Feature] Remove Hardcoded Flash Attention in Bagel & Support GQA in SDPA Backend ( #3728 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-29 10:36:15 +08:00
NATURE
4987bec425
[bugfix] Solve Nightly / CI failed - tests/e2e/online_serving/test_bagel_expansion.py #3918 ( #3936 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-29 02:05:07 +00:00
amy-why-3459
5dd1d0a772
[BugFix] Fix prefix-caching issue ( #3726 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-29 01:51:54 +00:00
ChenWenjing and Gao Han
834abdaf8b
[ci][nightly] Voxcpm2 performance benchmark ( #3864 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-29 09:44:29 +08:00
wuli666 and wuli666
8935439428
[Bugfix] Fix Triton SnakeBeta kernel for bf16/fp16 inputs ( #3472 )
...
Signed-off-by: wuli666 <djjpro975@gmail.com >
Co-authored-by: wuli666 <djjpro975@gmail.com >
2026-05-28 17:10:36 +00:00
knlnguyen1802 and Samit
5eac50f22c
[bugfix, rl] Fix sleep do not release full memory in custom pipeline ( #3818 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
2026-05-28 22:27:27 +08:00
126fb4b4a9
[Blackwell][1/N] Add SageAttention3 diffusion backend on blackwell(GB200/B200/RTX5090/PRO6000/DGX Spark available) ( #3015 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-28 14:08:45 +00:00
zhumingjue138
8d9a4afed9
[Test] Add scenarios for L5 reliability test ( #3729 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
2026-05-28 21:41:33 +08:00
WeiQing Chen and WeiQing Chen
1acd27c205
[CI][BugFix] Fix and Validate FP8 Z-Image quality gate ( #3929 )
...
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
Co-authored-by: WeiQing Chen <david6666666@users.noreply.github.com >
2026-05-28 12:52:58 +00:00
Zeyu Huang | 黃澤宇
74258b18b7
[CI] Rectify L2~L4 Qwen Image Edit series tests ( #3901 )
2026-05-28 18:33:31 +08:00
mglyn
ee212d12b1
[CI][Bugfix] Add request id to LTX2.3 CFG parallel test ( #3934 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-28 17:26:16 +08:00
Nick Cao and Claude
c20afebce4
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively ( #3360 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-28 16:20:49 +08:00
Liang Lv
b72ffb82bb
[AutoRound] Support GLM-Image W4A16 quantization model ( #3059 )
...
Signed-off-by: lvliang-intel <liang1.lv@intel.com >
2026-05-28 07:19:06 +00:00
JiangJie Zhang
6fa9dbbe42
[Diffusion] Unify diffusion request identity on request_id ( #3744 )
...
Signed-off-by: jader <yjader@foxmail.com >
2026-05-28 14:56:56 +08:00
blonde and Claude Opus 4.6
beb00fce31
[Doc] Refine vace offline inference example README ( #3584 )
...
Signed-off-by: blondeCS <1580754914@qq.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
2026-05-28 14:45:45 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
mglyn
2b999429c4
[Feature] Add cfg-parallel for LTX-2.3 ( #3905 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-28 04:36:33 +00:00
WeiQing Chen
6031c7d393
[CI] Add HunyuanVideo 1.5 X2V accuracy tests ( #3852 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-28 11:09:45 +08:00
Chendi.Xue
1903cee56a
[MXFP8][XPU] enable mxfp8 using vLLM main repo method ( #3782 )
...
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
2026-05-28 02:47:22 +00:00
NumberWan and Hongsheng Liu
8766c0c59f
[Perf] Bagel Performance Nightly CI test ( #2175 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-28 09:41:46 +08:00
Ziming Huang and tzhouam
220ce0b4ea
[Test] Add long text output correctness test for Qwen3-Omni ( #3539 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Co-authored-by: tzhouam <tzhouam@connect.ust.hk >
2026-05-28 08:27:29 +08:00
Lancer and Alicia
5c3c81920b
[Bugfix] Ensure stage and diffusion subprocesses exit when parent dies unexpectedly ( #3751 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
2026-05-28 08:22:04 +08:00
Sy03 and Yueqian Lin
d37912b071
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving ( #3773 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-27 13:25:49 -05:00
Haco and zzhuoxin1508
37eebff674
[BugFix] Fix diffusion parallel_config YAML override and add deploy config field allowlist ( #3483 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: zzhuoxin1508 <zzhuoxin1508@users.noreply.github.com >
2026-05-28 01:00:32 +08:00
JohnJan
36dc32ff81
[Feature] support SP for FLUX.2-dev ( #3244 )
2026-05-27 20:43:02 +08:00
bjf-frz and Hongsheng Liu
c33ef34654
[Bugfix]Fix Hunyuan Image3 denoise flow alignment ( #3857 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-27 19:18:01 +08:00
Jason and Zeyu Huang | 黃澤宇
753508fe02
[Bugfix] Fix Qwen-Image-Edit-2511 TeaCache zero_cond_t handling ( #3219 )
...
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
2026-05-27 11:06:18 +08:00
TaffyOfficial and TaffyOfficial
3c48257f8d
[Feat][HunyuanImage3] Stream AR text for IT2I image edits ( #3723 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-05-27 12:27:11 +12:00
283873411a
glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config ( #3235 )
...
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-27 12:18:47 +12:00
mglyn
385df0359e
[BugFix] Fix LTX-2.3 audio latent padding for sequence parallelism ( #3854 )
...
Signed-off-by: mglyn <1203789601@qq.com >
2026-05-26 08:45:38 +00:00
lishunyang12