tzhouam and Claude Fable 5.1
188d021023
refactor(processors): drop _hf_processor_applies_updates overrides removed in vLLM 0.29
...
vLLM 0.29 deleted BaseMultiModalProcessor._hf_processor_applies_updates; no
reference to the hook remains anywhere in vllm/, so these six overrides were
never called. Delete them. No behaviour change.
Validation: pre-commit on the six files; CPU tests in tests/inputs and
tests/model_executor/models/{cosyvoice3,mimo_audio,step_audio2,omnivoice},
test_glm_tts_prompt_len.py and test_upstream_prompt_update_api.py pass;
the six processor modules import cleanly.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_01MpXe2LeRrUQGjZfKFaocMZ
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
efda9369a8
refactor: reduce copied vLLM 0.29 compatibility code
...
Reuse upstream weight mapping and multimodal processing, consolidate Omni processor bridges, and trim unused Hunyuan internals. Route no-media kwargs through the active renderer and preserve GLM generation prompt formatting.
Validation: 453 CPU tests passed, 7 skipped; processor imports, Ruff, and diff checks passed. GPU and end-to-end CI not rerun.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:53 +08:00
tzhouam
87a1fd8da2
rebase: adapt to vLLM v0.29 APIs
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-09-10 00:41:52 +08:00
fdaf4e31bd
Add vLLM-Omni library info to Hugging Face Hub requests ( #5381 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-08 10:08:38 -06:00
Jim Ban
711daacabf
[Bugfix][TTS] Make CosyVoice3 TRT plan publication concurrency-safe ( #6955 )
...
Signed-off-by: BANANASJIM <bananasjim1@gmail.com >
2026-09-03 06:44:42 +00:00
f90e992dc1
[Model] Optimize CosyVoice3 TensorRT stream handoff ( #5673 )
...
Signed-off-by: Allen Wu <allenwu2795@gmail.com >
Co-authored-by: TRAE CLI <noreply@bytedance.com >
Co-authored-by: Sy03 <1370724210@qq.com >
Co-authored-by: TRAE CLI <traecli@bytedance.com >
2026-08-25 22:51:46 -07:00
wy17003 and Hongsheng Liu
b454e34966
[Refactor][2/N Scheduler]Replace _FULL_PAYLOAD_INPUT_STAGES with a resolved stage transport capability. ( #6149 )
...
Signed-off-by: wy17003 <yaow17003@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-25 15:24:59 +08:00
akshatvishu
39c16d75a9
[tts][bugfix] Fix CosyVoice3 sampling and stage handoff ( #6424 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-08-22 21:20:57 -07:00
汪志鹏
dc72559d5d
[BugFix]: CosyVoice3 STFT window device mismatch ( #6454 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-08-21 19:45:46 +08:00
boatman
fc8946fcf5
[Perf][MiniCPM-O-4.5]Add CUDA Graph For HiFTGenerator ( #5869 )
...
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-08-09 22:29:49 +08:00
R0CKSTAR
ab0da662c0
[Hardware] Enable CosyVoice3 on Moore Threads MUSA ( #5164 )
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2026-07-29 02:46:27 +00:00
Yukim1 and Hongsheng Liu
793d3e9ab7
[Config] Return VllmOmniConfig from create_from_model ( #4818 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-18 09:21:07 +00:00
amy-why-3459
9a44e7e019
[Refactor][Phase 1]Remove redundant functions and logs ( #4986 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-10 15:13:35 +08:00
Nick Cao
67d14b5ac4
[Refactor] Replace hardcoded CUDA device selection with platform-agnostic API ( #4496 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-06-23 14:38:32 +08:00
Yueqian Lin
208932210f
[Chore][TTS] Reference recipes.vllm.ai recipes, remove dead code, and fix stale references ( #4567 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-19 15:05:26 +08:00
Yuekai Zhang and Claude Opus 4.8
f1bf544208
[Perf][TTS] Optimize cosyvoice TTFP and throughput using TensorRT ( #4168 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-10 16:42:34 +08:00
Yuekai Zhang
a1cc583665
fix: cosyvoice3 batch>1 inference ( #3910 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
2026-06-04 08:58:53 +00:00
+1
f92d84fcf9
[Rebase] Rebase to vllm releases/v0.22.0 ( #3891 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: david6666666 <530634352@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: nainiu258 <cperfect02@163.com >
Signed-off-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: skf <54565339+skf-1999@users.noreply.github.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: nainiu258 <101917677+nainiu258@users.noreply.github.com >
Co-authored-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-01 11:08:12 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
BeatSeat
dab596e468
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules ( #3886 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
2026-05-27 23:41:35 -05:00
Yuanheng Zhao
a64ebf103b
[Refactor] Migrate and clean up TTS configs: CosyVoice3, OmniVoice, VoxCPM ( #3338 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-17 07:32:34 +08:00
dsinghvi
e40076e872
[Refactor] msgspec standardisation for data entry key names and improved type checks ( #3149 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
2026-05-12 14:30:13 +08:00
Juan Pablo Zuluaga and JuanPZuluaga
b64ab05d09
[TTS][SpeakerCacheManager] A global speaker cache manager for Voice Cloning ( #2630 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
2026-05-05 10:53:45 -04:00
Yueqian Lin and SYLAR
3f504b45d2
[Config Refactor] Migrate 5 TTS models (VoxCPM2 / CosyVoice3 / MiMo Audio / Voxtral TTS / Fish Speech S2 Pro) to Pipeline + Deploy schema ( #2958 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-21 21:17:53 +08:00
Nick Cao and Claude
2bc183f6f0
[Refactor] Remove dependency on librosa ( #2273 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-11 02:11:31 +08:00
indevn and linyueqian
6fc38e0467
[Model][Core] Enable async_chunk streaming pipeline for CosyVoice3 ( #1703 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: indevn <indevn@outlook.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
2026-04-05 06:11:33 +00:00
Yueqian Lin
d92439c155
[CosyVoice3] Fix vLLM 0.19.0 compatibility issues ( #2486 )
2026-04-05 08:45:49 +08:00
Zhou Taichang
2804a85e58
[Rebase] Rebase to vllm v0.19.0 ( #2475 )
2026-04-04 15:03:32 +08:00
Yueqian Lin
4c031580cf
[CosyVoice3] Add online serving support, fix stage config, and add CI tests ( #2431 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-04-04 14:55:15 +13:00
Lidang Jiang and Claude Opus 4.6
515d15ef87
[Cleanup] Replace bare print() with logger and use specific exception types ( #2228 )
...
Signed-off-by: Lidang Jiang <lidangjiang@gmail.com >
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
2026-04-03 23:59:07 +08:00
dsinghvi and Hongsheng Liu
b63e7c7c9a
[Model] Fun cosy voice3-0.5-b-2512 ( #498 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-04 19:54:59 -05:00