SYLAR
f0cec3ecd4
Merge branch 'main' into lance-model-support
2026-05-22 04:13:58 +08:00
Jialong Liu and Yueqian Lin
e949ccf087
[Bugfix] Fix MiMo-Audio voice instability: stochastic local_sampler + codec streaming context ( #3686 )
...
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-21 10:18:00 -04:00
Yueqian Lin
fc8486cf20
[Doc][TTS] CosyVoice3 online docs + residual TTS yaml cleanup + remove VoxCPM v1 ( #3748 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-20 15:24:06 +08:00
yangsonglin13
1c530d984d
Yuanrong TransferEngine Connector for NPU ( #3180 )
...
Signed-off-by: yangsonglin13 <yangsonglin566@gmail.com >
2026-05-20 14:51:33 +08:00
lishunyang
69bcc6416d
[New Model] Lance (ByteDance) — unified AR+diffusion multimodal ( #3697 )
...
Adds Lance (bytedance-research/Lance), a 3B unified AR+diffusion
multimodal model on a Qwen2.5-VL backbone. Lance is BAGEL-lineage:
it reuses vLLM-Omni's BAGEL Mixture-of-Transformers core verbatim and
specializes only the ViT (Qwen2.5-VL vision), the VAE (Wan2.2) and the
checkpoint layout.
All six single-stage Lance modalities verified end-to-end on 1x B300:
t2i, t2v, image_edit, video_edit, x2t_image (image understanding) and
x2t_video (video understanding). 3-D mRoPE is wired through
BagelRotaryEmbedding for the x2t / video / edit paths. Includes the
upstream gap-analysis quality fixes (task-specific system prompts, full
Qwen chat template, upstream inference defaults and aspect-ratio
buckets).
Ships an offline example (examples/offline_inference/lance/), an
OpenAI-compatible online-serving example
(examples/online_serving/lance/) and an e2e test
(tests/e2e/online_serving/test_lance.py).
See LANCE_PR.md for the architecture rationale, per-modality status and
the two remaining follow-ups (two-stage AR+DiT, video_edit polish).
Closes #3697 .
Signed-off-by: lishunyang <lishunyang03@gmail.com >
2026-05-18 22:09:14 +00:00
c99df1ebd9
[TTS][Perf] Optimize Qwen3-TTS high-concurrency serving ( #3662 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-17 16:58:59 -04:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
Y. Fisher
51b4b1131e
[Bugfix]: Fix online serving failure when using deploy config ( #3537 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Y. Fisher <yukexiong1@huawei.com >
2026-05-14 11:17:15 +08:00
d7ea5d5979
[New Model] Add support for tencent/Covo-Audio-Chat ( #2293 )
...
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 14:39:58 +08:00
Y. Fisher
a33e2eb588
[Config] Add HunyuanImage3 deploy configs ( #3172 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Y. Fisher <yukexiong1@huawei.com >
2026-05-11 22:49:19 +08:00
Sy03
2c73cf3522
[Perf] Fix Qwen3-TTS latency regression ( #3485 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-05-10 23:07:38 +00:00
wangyu and Huang, Zeyu
6f2ad7b403
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers ( #2556 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-05-08 14:12:23 +08:00
1e5f288a91
[FEAT] support multi-stage deployment ( #2396 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
2026-05-06 19:33:18 +08:00
b076006c35
[BugFix] Fix Whitelist optimization CI failure ( #3290 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-06 14:25:20 +08:00
TJian
a77c56725d
[ROCm] [CI] [Bugfix] 2/N Fix Qwen2.5 and Qwen3 test ( #3343 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-05-05 23:28:37 +08:00
Canlin Guo
c007d40b14
[NPU] Upgrade to v0.20.0 & align with GPU model runner ( #3325 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-04 22:38:43 +08:00
Yuanheng Zhao and Hongsheng Liu
d49356e4ca
[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs ( #3154 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-03 14:43:49 +12:00
Gao Han
704b6bb6e6
[CI failed]Revert "[Config Refactor] Derive deploy override fields from stage config" ( #3287 )
...
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-01 04:39:54 +01:00
Haco
01ebc0cdf5
[Config Refactor] Derive deploy override fields from stage config ( #3162 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
2026-05-01 01:04:03 +08:00
Yueqian Lin and Hongsheng Liu
afa2b09684
feat: add MOSS-TTS-Nano single-stage TTS support ( #2753 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-27 10:26:26 +08:00
Jared Wen and Hongsheng Liu
6e35bfbbae
Benchmark and Bugfix for GLM-Image ( #3024 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-25 20:49:19 +08:00
汪志鹏 and SYLAR
37e5954acf
[Config Refactor]: Remove bagel yaml ( #2936 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-24 21:21:30 +08:00
GXIN and gcanlin
9d1392dcfc
[NPU] Support code predictor NPU graph ( #2695 )
...
Signed-off-by: XIN GAO <1037396230@qq.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-04-22 10:15:08 +00:00
Jared Wen and SYLAR
554233208f
[ConfigRefactor] GLM-Image ( #2977 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: Jared Wen <w13431838023@gmail.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-22 15:09:28 +08:00
Chen-Yo Sun and Yueqian Lin
8e1bbc9ab5
[Feature][Voxtral TTS] Support per-model extra sampling params & add cfg_alpha for Voxtral TTS ( #2338 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-22 03:49:50 +00:00
Yueqian Lin and SYLAR
3f504b45d2
[Config Refactor] Migrate 5 TTS models (VoxCPM2 / CosyVoice3 / MiMo Audio / Voxtral TTS / Fish Speech S2 Pro) to Pipeline + Deploy schema ( #2958 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-21 21:17:53 +08:00
Haco
ad7c966b1d
[BugFix] add missing subtalker sampling config to Qwen3-TTS deploy YAML ( #2940 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
2026-04-21 14:47:22 +08:00
a3903810fe
[Config Refactor][2/N] Pipeline + Deploy Config Schema ( #2383 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: reidliu41 <reid201711@gmail.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: reidliu41 <reid201711@gmail.com >
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-19 14:36:00 +12:00
SYLAR