tzhouam and Claude Fable 5.1
ec3880df34
refactor(voxtral_tts): drop pass-through _cached_apply_hf_processor
...
After the vLLM 0.29 adaptation the override only returned
super()._cached_apply_hf_processor(inputs, timing_ctx). Delete it together
with the imports it alone used (MultiModalProcessingInfo, TimingContext).
The find-only _maybe_apply_prompt_updates override is unchanged.
Validation: ruff and pre-commit on the file; the module imports cleanly;
tests/model_executor/models/voxtral_tts passes (62 tests).
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_01MpXe2LeRrUQGjZfKFaocMZ
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
87a1fd8da2
rebase: adapt to vLLM v0.29 APIs
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:52 +08:00
fdaf4e31bd
Add vLLM-Omni library info to Hugging Face Hub requests ( #5381 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-08 10:08:38 -06:00
Juan Pablo Zuluaga and Yueqian Lin
53afbf3a0c
[Perf][TTS] voxtral_tts hot path: cudagraph opt-out, host-sync removal, kernel caches ( #5175 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-10 21:03:32 -07:00
Yukim1 and Hongsheng Liu
793d3e9ab7
[Config] Return VllmOmniConfig from create_from_model ( #4818 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-18 09:21:07 +00:00
leo
267b49b880
Fix Voxtral TTS feedback and short ASR checks ( #4954 )
...
Signed-off-by: leo <yaoliu548926@gmail.com >
2026-07-08 16:52:48 +00:00
504698dec8
[Core] Performance fix for orchestrator bottleneck: separates inter-stage from client outputs ( #4527 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Chenguang ZHENG <645327136@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-29 17:43:36 +02:00
Yueqian Lin
208932210f
[Chore][TTS] Reference recipes.vllm.ai recipes, remove dead code, and fix stale references ( #4567 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-19 15:05:26 +08:00
8f869c8ea5
[Refactor] Output Processor Phase 2: separate multimodal output channel ( #1601 ) ( #2744 )
...
Signed-off-by: Megha Agarwal <agarwalmegha1308@gmail.com >
Signed-off-by: meghaagr13 <divyanshsinghvi@gmail.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: meghaagr13 <divyanshsinghvi@gmail.com >
Co-authored-by: Boao Shi <aoibosh@connect.hku.hk >
Co-authored-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-12 15:19:14 +08:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
f6e3dece09
[Feature] Add FP8 quantization for Voxtral TTS ( #3036 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Signed-off-by: akshatvishu <33392262+akshatvishu@users.noreply.github.com >
Co-authored-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-08 22:40:36 -04:00
Nick Cao
e6466cf0e6
[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. ( #3365 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-07 23:23:59 +08:00
Yuanheng Zhao
6b52db9e2b
[Bugfix][Refactor] Migrate Voxtral TTS config and parser registry ( #3065 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-04-25 18:17:25 +08:00
Chen-Yo Sun and Yueqian Lin
8e1bbc9ab5
[Feature][Voxtral TTS] Support per-model extra sampling params & add cfg_alpha for Voxtral TTS ( #2338 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-22 03:49:50 +00:00
Yueqian Lin and SYLAR
3f504b45d2
[Config Refactor] Migrate 5 TTS models (VoxCPM2 / CosyVoice3 / MiMo Audio / Voxtral TTS / Fish Speech S2 Pro) to Pipeline + Deploy schema ( #2958 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-21 21:17:53 +08:00
Chen-Yo Sun
dd1389173b
[Voxtral TTS] Fix Voxtral TTS input with text and ref_audio ( #2750 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-04-13 22:37:45 +00:00
Chen-Yo Sun
c9e2e3e8d7
[Voxtral TTS] Correct decode steps param in Voxtral TTS ( #2524 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-04-13 17:53:35 +00:00
Nick Cao and Claude
149b9f179a
[Perf][Qwen3-TTS][Voxtral-TTS] Share CUDA graph memory pool across decoder capture sizes ( #2386 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-08 20:40:17 -04:00
Joshna-Medisetty
191b9a8dbf
Voxtral TTS: drop hardcoded CUDA in audio tokenizer; add XPU stage config ( #2428 )
...
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com >
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com >
2026-04-04 07:04:04 +00:00
Zhou Taichang
2804a85e58
[Rebase] Rebase to vllm v0.19.0 ( #2475 )
2026-04-04 15:03:32 +08:00
Yueqian Lin
9857ed2839
[Bugfix] Fix Voxtral TTS voice embeddings not loading ( #2156 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-26 21:34:31 +08:00
Chen-Yo Sun
e776082095
[Voxtral TTS] Use 8 step flow matching instead of 16 ( #2158 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-03-25 04:33:18 +00:00
Chen-Yo Sun
e9fe78e28c
[Model] Add Voxtral TTS model ( #1803 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-03-19 16:02:11 -04:00