 Nick CaoandClaude
|
f2edb81a59
|
[Cleanup] Remove dead runtime.defaults config parameters (#2343)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-17 23:36:41 +08:00 |
|
|
Yuanheng Zhao
|
c0ccbb872f
|
[Model] Add Ming-flash-omni-2.0 Thinker Stage (#1822)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-04-17 19:10:02 +08:00 |
|
|
Bingyu (Spencer) Liu
|
a5a4998ece
|
[Feature] Support Prefill-Decode disaggregation via vLLM KV transfer (#2220)
Signed-off-by: LiuBingyu <liubingyu62@gmail.com>
|
2026-04-17 18:43:17 +08:00 |
|
|
Nick CaoandClaude
|
1e3bb36521
|
[Refactor] Remove sox from dependencies (#2745)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-17 01:24:47 +00:00 |
|
|
|
c3ca5daafb
|
Feat/Add HunyuanImage-3.0-Instruct ar part support: (#2713)
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-16 23:15:25 +08:00 |
|
|
Sy03
|
7d64a7c996
|
[BugFix][VoxCPM2]: split multichar Chinese tokens to match training tokenization (#2832)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-16 10:07:48 -05:00 |
|
|
Sy03
|
322620fd57
|
[Fix][Fish Speech] Remove redundant get_vocab() in control token encoding (#2842)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-16 12:47:39 +00:00 |
|
|
Juan Pablo ZuluagaandHongsheng Liu
|
82f8c93343
|
[Feat][Qwen3-Omni] Shared code predictor module for Qwen3-TTS and Qwen3-Omni (#2375)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-15 15:14:57 +08:00 |
|
|
|
4bf4c63147
|
Add voxcpm model support. (#2467)
Signed-off-by: Celeste-jq <591998922@qq.com>
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com>
Signed-off-by: IsleOfDawnlight <stellamou@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Celeste-jq <591998922@qq.com>
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-04-15 15:04:58 +08:00 |
|
|
Sy03
|
38d5f2d530
|
[Perf] VoxCPM2: Speedup by manual CUDA Graph capture for scaffold/residual forward (#2803)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-15 14:09:22 +08:00 |
|
|
TaffyOfficial
|
1ad726f495
|
[Fix] HunyuanImage-3.0: unify naming hunyuan_image_3 → hunyuan_image3 (#2712)
|
2026-04-14 21:53:47 -07:00 |
|
|
Yueqian Lin
|
02e5dc747d
|
[Perf] VoxCPM2: streaming VAE + compile optimization (45% RTF reduction) (#2758)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-04-15 09:58:25 +08:00 |
|
|
Yiyang "Ian" LiuandSYLAR
|
bc4a659f03
|
[Bugfix] Make mrope kwargs optional in HunyuanImage3 get_mrope_input_positions (#2654)
Signed-off-by: Yiyang Liu <yiyangliu@microsoft.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-04-14 14:41:28 +00:00 |
|
|
Yiyang "Ian" LiuandCopilot
|
53a9cf49a6
|
fix: do not apply FP8 quant config to vision/audio encoders for pre-quantized checkpoints (#2702)
Signed-off-by: Yiyang Liu <37043548+ianliuy@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
2026-04-14 13:52:32 +00:00 |
|
|
iancarrasco-b10
|
48c30bc399
|
[Qwen3-TTS] Remove hardcoded distributed_executor_backend to improve single-GPU performance (#2604)
Signed-off-by: Ian Carrasco <ian.carrasco@baseten.co>
|
2026-04-14 14:49:13 +08:00 |
|
|
Chen-Yo Sun
|
dd1389173b
|
[Voxtral TTS] Fix Voxtral TTS input with text and ref_audio (#2750)
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
|
2026-04-13 22:37:45 +00:00 |
|
|
|
14f7910900
|
[Perf]: Speedup VoxCPM2 TTS performance and Support PagedAttention (#2690)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-14 09:16:47 +12:00 |
|
|
Chen-Yo Sun
|
c9e2e3e8d7
|
[Voxtral TTS] Correct decode steps param in Voxtral TTS (#2524)
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
|
2026-04-13 17:53:35 +00:00 |
|
|
Yueqian Lin
|
d9e745ce2c
|
[Fix] VoxCPM2: support raw audio for voice cloning via OpenAI API (#2720)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-04-13 06:30:56 +00:00 |
|
|
Sy03
|
cb4d13a658
|
[Perf][Fish Speech] Enable CUDA Graph capture for Fast AR code predictor (#2520)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-13 04:53:35 +00:00 |
|
|
NATURE
|
e12250119b
|
[Bugfix] Fix Bagel online mode for 1. Hang after several requests 2. Non-deterministic image quality regression. (#2458)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
|
2026-04-13 03:36:20 +00:00 |
|
|
ReidandHongsheng Liu
|
38dfe56fdf
|
[Bugfix] Validate speaker in chat endpoint and fix case-insensitive lookup (#2407)
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-12 00:14:16 -04:00 |
|
|
Juan Pablo Zuluaga
|
f7e8df9dbd
|
[TTS][OmniVoice] Add voice cloning support for OmniVoice TTS (#2676)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
|
2026-04-11 12:14:03 -04:00 |
|
|
Nick Cao
|
eccee21c6c
|
[Perf] Use global CUDA graph pool for MiMo Audio (#2657)
Signed-off-by: Nick Cao <ncao@redhat.com>
|
2026-04-11 13:45:26 +00:00 |
|
|
teithandYueqian Lin
|
001f2e32e2
|
[BUG FIX]: prevent EngineCore crash when Qwen TTS Base task is missing ref_text (#2203)
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-11 02:46:38 +00:00 |
|
|
Yueqian LinandSYLAR
|
a41174e083
|
[Model] VoxCPM2 native AR TTS support (#2658)
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: SYLAR <lishunyang12@users.noreply.github.com>
|
2026-04-11 10:21:26 +08:00 |
|
|
Nick CaoandClaude
|
2bc183f6f0
|
[Refactor] Remove dependency on librosa (#2273)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-11 02:11:31 +08:00 |
|
|
|
687405c5f2
|
[Config] Remove invalid LLM-only engine_args from diffusion stage configs (#2622)
Signed-off-by: Yiyang Liu <yiyangliu@microsoft.com>
Co-authored-by: Yiyang Liu <yiyangliu@microsoft.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
2026-04-11 01:36:29 +12:00 |
|
|
Yueqian Lin
|
94232436bb
|
[Feat][FishSpeech] Cache DAC-encoded ref audio for voice cloning (#2609)
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-10 10:34:03 +08:00 |
|
|
Sy03
|
694be6f2e1
|
[Bugfix] Fix Fish Speech voice clone FileNotFoundError on multi-GPU (#2606)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-09 20:34:34 +00:00 |
|
|
|
e2b0ee4b87
|
[Model] Add Dynin-omni model in vllm-omni (#1759)
Signed-off-by: kdg6245@snu.ac.kr <kdg6245@snu.ac.kr>
Signed-off-by: Yejoon Lee (IPAI) <leeyejoon@snu.ac.kr>
Signed-off-by: aidas (arpa-kt) <aidaslab@gmail.com>
Signed-off-by: Dogeun Kim <82812668+DOGEUNNKIM@users.noreply.github.com>
Co-authored-by: Yejoon Lee (IPAI) <leeyejoon@snu.ac.kr>
Co-authored-by: aidas (arpa-kt) <aidaslab@gmail.com>
|
2026-04-09 16:37:34 +08:00 |
|
|
Nick CaoandClaude
|
149b9f179a
|
[Perf][Qwen3-TTS][Voxtral-TTS] Share CUDA graph memory pool across decoder capture sizes (#2386)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-08 20:40:17 -04:00 |
|
|
|
c3c736d488
|
[Feature] Port Bagel RDMA flow to latest main (#2000)
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: ahengljh <ahengljh@users.noreply.github.com>
Co-authored-by: natureofnature <wzliu@connect.hku.hk>
|
2026-04-08 14:55:35 +08:00 |
|
|
汪志鹏
|
5b2c4f909d
|
[BugFix] Add bagel text2text/img2text think mode support (#2503)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-04-07 13:29:26 +12:00 |
|
|
Zhengyuan Su (苏政渊)andClaude
|
486d77d797
|
[Feature] Enable LoRA adapter injection for BAGEL (#2490)
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Signed-off-by: Claude <noreply@anthropic.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-06 19:30:52 +08:00 |
|
|
|
e23b2634d1
|
fix(qwen3_tts): align code predictor buffer dtype with model parameters (#2470)
Signed-off-by: willamhou <willamhou@ceresman.com>
Co-authored-by: willamhou <willamhou@ceresman.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Happy <yesreply@happy.engineering>
|
2026-04-05 20:54:15 +00:00 |
|
|
Sy03
|
8b57c6205e
|
[Perf][Fish Speech] Free unused DAC codec components to save VRAM (#2430)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-05 20:49:18 +00:00 |
|
|
Sy03andYueqian Lin
|
f6cfacdd16
|
[Perf][Qwen3-TTS] Free unused decoder in Talker SpeechTokenizer to VRAM (#2429)
Signed-off-by: Sy03 <1370724210@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-05 19:04:37 +00:00 |
|
|
Sy03
|
025408f693
|
[Fix] [Qwen3-TTS] Qwen3-TTS streaming chunk-boundary artifacts (#2480)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-04-05 14:40:38 -04:00 |
|
|
Yuanheng Zhao
|
094907eeee
|
[Chore] Fix Bagel model import compatibility (#2491)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-04-05 06:47:08 +00:00 |
|
|
indevnandlinyueqian
|
6fc38e0467
|
[Model][Core] Enable async_chunk streaming pipeline for CosyVoice3 (#1703)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: indevn <indevn@outlook.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
|
2026-04-05 06:11:33 +00:00 |
|
|
Yueqian Lin
|
d92439c155
|
[CosyVoice3] Fix vLLM 0.19.0 compatibility issues (#2486)
|
2026-04-05 08:45:49 +08:00 |
|
|
Joshna-Medisetty
|
191b9a8dbf
|
Voxtral TTS: drop hardcoded CUDA in audio tokenizer; add XPU stage config (#2428)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com>
|
2026-04-04 07:04:04 +00:00 |
|
|
Zhou Taichang
|
2804a85e58
|
[Rebase] Rebase to vllm v0.19.0 (#2475)
|
2026-04-04 15:03:32 +08:00 |
|
|
Yueqian Lin
|
4c031580cf
|
[CosyVoice3] Add online serving support, fix stage config, and add CI tests (#2431)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-04-04 14:55:15 +13:00 |
|
|
+11
|
f50c5a413f
|
[Qwen3TTS] [TTS] [Feat] Refactor voice cache manager (#2108)
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Binh Tang <tangbinhna@gmail.com>
Signed-off-by: Binh Tang <binht@netflix.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Signed-off-by: vraiti <vraiti@redhat.com>
Signed-off-by: Songrui625 <songrui625@gmail.com>
Signed-off-by: Lidang Jiang <lidangjiang@gmail.com>
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: Yi Liu <yi4.liu@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: Binh Tang <tangbinhna@gmail.com>
Co-authored-by: Binh Tang <binht@netflix.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com>
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com>
Co-authored-by: ChenWenjing <54166744+Shirley125@users.noreply.github.com>
Co-authored-by: vraiti <vraiti@redhat.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Jerry Song <46962917+Songrui625@users.noreply.github.com>
Co-authored-by: Lidang Jiang <119769478+Lidang-Jiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-04-03 16:51:58 -04:00 |
|
|
Yueqian Lin
|
0e83ebe1d4
|
[OmniVoice] Add two-stage TTS serving support (#2463)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-04-03 20:41:20 +00:00 |
|
|
Lidang JiangandClaude Opus 4.6
|
515d15ef87
|
[Cleanup] Replace bare print() with logger and use specific exception types (#2228)
Signed-off-by: Lidang Jiang <lidangjiang@gmail.com>
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-04-03 23:59:07 +08:00 |
|
|
Sy03
|
7fb86d51cd
|
[BugFix][FishSpeech] Fix structured voice clone prefill conditioning (#2446)
|
2026-04-03 06:56:33 +00:00 |
|
|
汪志鹏
|
fa275fd1be
|
[BAGEL] [Feature]: Add thinking mode in Bagel multi-stage serving (#2447)
|
2026-04-03 11:47:57 +08:00 |
|