SYLAR
f0cec3ecd4
Merge branch 'main' into lance-model-support
2026-05-22 04:13:58 +08:00
8297570c2b
[AutoRound] Support WAN2.2 W4A16 quantization model ( #3353 )
...
Signed-off-by: lvliang-intel <liang1.lv@intel.com >
Signed-off-by: hyh_hh <huyinghong1@huawei.com >
Co-authored-by: hxhhhlalala <hyh_hh@163.com >
Co-authored-by: hyh_hh <huyinghong1@huawei.com >
2026-05-21 17:54:41 +08:00
wangyu
e1c6bc7597
[Test] add run_nightly_jobs.sh for local nightly pytest parity ( #3670 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-20 15:26:59 +08:00
Yueqian Lin
fc8486cf20
[Doc][TTS] CosyVoice3 online docs + residual TTS yaml cleanup + remove VoxCPM v1 ( #3748 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-20 15:24:06 +08:00
wangyu
bd83ac9b4b
[CI] invalid_param reliability suite and weekly http_invalid jobs ( #3652 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-19 14:28:47 +08:00
lishunyang
69bcc6416d
[New Model] Lance (ByteDance) — unified AR+diffusion multimodal ( #3697 )
...
Adds Lance (bytedance-research/Lance), a 3B unified AR+diffusion
multimodal model on a Qwen2.5-VL backbone. Lance is BAGEL-lineage:
it reuses vLLM-Omni's BAGEL Mixture-of-Transformers core verbatim and
specializes only the ViT (Qwen2.5-VL vision), the VAE (Wan2.2) and the
checkpoint layout.
All six single-stage Lance modalities verified end-to-end on 1x B300:
t2i, t2v, image_edit, video_edit, x2t_image (image understanding) and
x2t_video (video understanding). 3-D mRoPE is wired through
BagelRotaryEmbedding for the x2t / video / edit paths. Includes the
upstream gap-analysis quality fixes (task-specific system prompts, full
Qwen chat template, upstream inference defaults and aspect-ratio
buckets).
Ships an offline example (examples/offline_inference/lance/), an
OpenAI-compatible online-serving example
(examples/online_serving/lance/) and an e2e test
(tests/e2e/online_serving/test_lance.py).
See LANCE_PR.md for the architecture rationale, per-modality status and
the two remaining follow-ups (two-stage AR+DiT, video_edit polish).
Closes #3697 .
Signed-off-by: lishunyang <lishunyang03@gmail.com >
2026-05-18 22:09:14 +00:00
amy-why-3459
309e5c38c6
[BugFix][CI]Fixing occasional CI failures ( #3623 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-18 21:25:37 +08:00
Yuanheng Zhao
a64ebf103b
[Refactor] Migrate and clean up TTS configs: CosyVoice3, OmniVoice, VoxCPM ( #3338 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-17 07:32:34 +08:00
WeiQing Chen
b5e163cfca
[CI][Accuracy] Add Qwen-Image-2512 Qwen-Image-Edit-2511 pixel accuracy tests ( #3502 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-16 20:08:51 +08:00
dengyunyang and Hongsheng Liu
d647e7e4cf
[Hunyuanimage 3.0] hunyuan accuracy test ( #3655 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-16 23:35:05 +12:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
Zeyu Huang | 黃澤宇 and Copilot Autofix powered by AI
d18168ccbb
[bugfix] Fix diffusers backend input bug after #2913 ( #3644 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-15 09:55:09 +00:00
amy-why-3459
e7ee5de09f
[BugFix] Fix the issue of thinker requests being preempted, causing shape mismatch. ( #3147 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-15 17:07:42 +08:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
knlnguyen1802 and Samit
631251a1f8
[Bugfix, rl] Diffusion worker SIGKILL under Ray actor (exitcode -9) ( #3533 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
2026-05-13 15:31:48 +08:00
Canlin Guo
0ab1d30056
[CI][Test] Add NPU nightly tests ( #3480 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-13 16:58:17 +12:00
rein yang
f4b28f2398
[CI] update daily omni min accuracy ( #3536 )
...
Signed-off-by: rein yang <ruiruyang2@gmail.com >
2026-05-12 22:10:10 +08:00
d7ea5d5979
[New Model] Add support for tencent/Covo-Audio-Chat ( #2293 )
...
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 14:39:58 +08:00
NumberWan
9a60e11e3d
[Nightly CI] Remove TP case ( #3534 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
2026-05-12 05:59:04 +00:00
dengyunyang and Hongsheng Liu
0d91fbbbb7
[Bugfix] Align the AR and DiT prompt formatting across both online and offline modes. ( #3516 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 12:13:30 +08:00
wangyu
ac5fbed6c0
[CI][Bugfix] Improve e2e latency logging, update response classes to include detailed latency documentation and add startup time logging ( #3246 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
2026-05-12 10:23:56 +08:00
Y. Fisher
a33e2eb588
[Config] Add HunyuanImage3 deploy configs ( #3172 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Y. Fisher <yukexiong1@huawei.com >
2026-05-11 22:49:19 +08:00
汪志鹏
c9a8556c24
[New Model]: Add sensenova u1 support ( #3319 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-05-11 22:19:00 +08:00
wangyu
2cdffcea6b
[CI] skip failing diffusion and accuracy cases ( #3432 , #3256 , #3257 , #3488 ) ( #3507 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-11 21:56:08 +08:00
wangyu and Hongsheng Liu
26d481fc84
[CI] Remove VLLM_TEST_CLEAN_GPU_MEMORY to avoid environment variable pollution that causes unnecessary GPU detection, thereby slowing down test case execution. ( #3446 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-10 07:00:29 +08:00
Yueqian Lin
ac69cbd27e
[Test] Restore tts mark and omni_runner_function fixture for Voxtral TTS ( #3462 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-09 15:22:43 +08:00
f6e3dece09
[Feature] Add FP8 quantization for Voxtral TTS ( #3036 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Signed-off-by: akshatvishu <33392262+akshatvishu@users.noreply.github.com >
Co-authored-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-08 22:40:36 -04:00
rongfu.leng
b4ab37da22
[Bugfix] Qwen-Image use teachche serve will crash ( #3450 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
2026-05-09 06:41:59 +08:00
Yueqian Lin
c2a624bec4
[Bugfix][StableAudio] Pass model_class_name to Omni() and declare audio class attrs ( #3405 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-09 06:40:43 +08:00
TaffyOfficial and TaffyOfficial
07fd6afb4b
[Test][HunyuanImage3] Add e2e offline I2T smoke test ( #3332 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
2026-05-08 20:55:23 +08:00
dengyunyang
5b61e7f1f1
[Feature][Hunyuan image 3.0] AR + DIT with kv reuse. ( #3346 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-05-08 20:51:46 +08:00
lsyyyyy and 汪志鹏
32663f21d5
[Feat] support hsdp for Bagel ( #3150 )
...
Signed-off-by: siyuan.lei <siyuanlei37@gmail.com >
Signed-off-by: lsyyyyy <siyuanlei37@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-05-08 15:20:42 +08:00
wangyu and Huang, Zeyu
6f2ad7b403
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers ( #2556 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-05-08 14:12:23 +08:00
Nick Cao
e6466cf0e6
[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. ( #3365 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-07 23:23:59 +08:00
Gao Han
54277a8dd0
[chore] Update command to download dataset from huggingface-cli to hf ( #3403 )
...
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-07 16:16:36 +08:00
b25ea13cb0
[BugFix] Fixed a precision issue with one-word answers. ( #3385 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Canlin Guo <961750412@qq.com >
2026-05-07 06:21:00 +08:00
amy-why-3459 and Gao Han
282e0b6642
[BugFix][CI] Change max_tokens from 150 to 2048 ( #3376 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-06 20:42:56 +08:00
1e5f288a91
[FEAT] support multi-stage deployment ( #2396 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
2026-05-06 19:33:18 +08:00
Yueqian Lin
354511b805
[CI][Bugfix] Relax stable-audio layerwise offload determinism tolerance to 1e-2 ( #3371 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-06 11:32:39 +08:00
TJian
a77c56725d
[ROCm] [CI] [Bugfix] 2/N Fix Qwen2.5 and Qwen3 test ( #3343 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-05-05 23:28:37 +08:00
boatman and sphinxkkkbc
a0918ce583
[Feat]add cpu-offload/layerwise-offload for stable-audio-open & fix output inconsistency with same seed ( #2909 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-05 10:49:57 -04:00
Zeyu Huang | 黃澤宇 and Copilot Autofix powered by AI
f19891e4f1
[bugfix][CI] Diffusers backend update ( #3096 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-05 20:54:39 +08:00
Yueqian Lin
703e31fc47
[Docs] Consolidate per-model TTS examples into a single hub ( #3234 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-05 08:41:29 +12:00
Alex Brooks
e1b30061b6
[CI] Use Logprobs Check for Flaky Prefix Cache Test ( #3199 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-05-05 00:55:54 +08:00
c708aecb18
[Diffusion] [Model] Support AudioX ( #2077 )
...
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang <zhang.jian@u.nus.edu >
Signed-off-by: Zhang Jian <e0322744@u.nus.edu >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Zhang Jian <e0322744@u.nus.edu >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-05-04 10:24:35 -04:00
Lancer
4c06bb09ed
[Feat] ERNIE image model (T2I) ( #2861 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-05-03 15:53:28 +08:00
Yueqian Lin and Hongsheng Liu
7491b67446
[Bugfix][MOSS-TTS-Nano] Drop fictional voice presets, require ref_audio ( #3192 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-03 16:35:35 +12:00
Yuanheng Zhao and Hongsheng Liu
d49356e4ca
[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs ( #3154 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-03 14:43:49 +12:00
Jason
38d440109b
[Bugfix] Validate Qwen3-TTS speaker embedding dimensions before engine execution ( #3191 )
...
Signed-off-by: Jiahui Sun <jhsun2020@gmail.com >
2026-05-01 18:39:49 +00:00
Gao Han
704b6bb6e6
[CI failed]Revert "[Config Refactor] Derive deploy override fields from stage config" ( #3287 )
...
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-01 04:39:54 +01:00
SYLAR