Sy03
55855fee9c
[Model] Reduce MOSS-TTS Local intermediate output overhead
...
Keep internal talker control outputs FINAL_ONLY while codec audio remains incremental. Reapply pipeline sampling constraints after default streaming coercion, log routine coercions at debug level, and cover explicit/default parameters with regression tests. Document matched high-concurrency statistics settings.
Signed-off-by: Sy03 <1370724210@qq.com >
2026-09-08 01:15:46 +08:00
Sy03
dcd6588a36
[Perf][MOSS-TTS] Avoid synchronization in batched index transfers
...
Construct MTP row offsets and mixed prefill/decode stop indices on the CPU, then enqueue nonblocking device transfers before batched writes. Add CUDA regressions for synchronization, row placement, stop flags, and snapshot ownership.
Signed-off-by: Sy03 <1370724210@qq.com >
2026-09-08 00:39:50 +08:00
Sy03
251ef4f48f
[Model] Optimize MOSS-TTS Local batched execution and streaming codec
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-09-07 16:20:49 +08:00
BruceLoveDecimal and Claude Opus 5
1e74807c35
[Feature][Moss-TTS] Reference Audio Preprocessing ( #4982 )
...
Signed-off-by: BruceLoveDecimal <39156883+BruceLoveDecimal@users.noreply.github.com >
Signed-off-by: liuqihao <liuqihao970610@gmail.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-09-04 16:36:26 -07:00
Inesh Reddy Chappidi and Gao Han
66d938100b
[Bugfix] Give exact-shape codec models an unpadded input_ids view ( #6775 )
...
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com >
Signed-off-by: IneshReddy249 <ineshreddy249@gmail.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-09-04 15:28:49 -07:00
jingchengtian
67ef0b64b9
[Hardware][Ascend] Use npu_rotary_mul fused kernel for MOSS-TTS codec RoPE ( #6908 )
...
Signed-off-by: jingchengtian <tjc1995@126.com >
2026-09-02 08:58:23 +00:00
be335a86f9
fix(npu): extend bf16 autocast to NPU in MossAudioTokenizer decode ( #6664 )
...
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-08-28 04:01:49 -07:00
Pranav Thakur and Zhou Taichang
53b60bd9bc
[Bugfix] Invalidate stale ref_audio cache on local file modification ( #4873 ) ( #5670 )
...
Signed-off-by: pranavthakur0-0 <pranavthakurdew@gmail.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
2026-08-25 10:06:32 +08:00
37c11e6e4f
[Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor ( #5791 )
...
Signed-off-by: sheenlin <sheenlin@tencent.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: sheenlin <sheenlin@tencent.com >
Co-authored-by: yurain <yurain26@users.noreply.github.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-08-20 19:22:40 +00:00
Sy03
26e003715c
[Perf] Enable async schedule for MOSS-TTS ( #6241 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-08-19 06:36:19 +00:00
Wallbreazzz
740cb35a59
[BugFix] Fix MOSS-TTS codec v1/v2 detection and align vendored tokenizer with upstream ( #5635 )
...
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com >
2026-08-05 08:24:32 +00:00
Gao Han
78c144f3a8
[CI failed] Revert "[Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor" ( #5777 )
2026-08-04 15:21:38 +00:00
6fdc4ca62d
[Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor ( #4958 )
...
Signed-off-by: sheenlin <sheenlin@tencent.com >
Co-authored-by: sheenlin <sheenlin@tencent.com >
Co-authored-by: yurain <yurain26@users.noreply.github.com >
2026-08-04 11:59:32 +00:00
Canlin Guo
18be2ba3df
[Perf] Enable compile for MOSS-TTS-Local v1.5 talker and codec ( #5530 )
...
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
2026-07-29 14:09:06 +08:00
Canlin Guo
61324e65d7
[Refactor] Make MOSS-TTS-Local stream session dynamic batch ( #5235 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
2026-07-28 21:38:24 +08:00
cbab1d4d8f
[Rebase] Rebase to vllm 0.26.0 ( #5443 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@gmail.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: tzhouam <tzhouam@gmail.com >
2026-07-27 23:35:49 +08:00
Canlin Guo and boatman
c56d0da1bb
[Perf] Refactor MOSS-TTS-Local v1.5 talker and local structure for CUDA Graph ( #5197 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
Co-authored-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com >
2026-07-24 19:08:17 +08:00
Yukim1 and Hongsheng Liu
793d3e9ab7
[Config] Return VllmOmniConfig from create_from_model ( #4818 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-18 09:21:07 +00:00
Canlin Guo and sunnyxyli
5c3900960b
[Feature] Support MOSS-TTS-Local-v1.5 vocoder graph ( #4929 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: sunnyxyli <1550693033@qq.com >
Co-authored-by: sunnyxyli <1550693033@qq.com >
2026-07-16 15:02:15 +08:00
Inesh Reddy Chappidi
4908b85731
[Bugfix] MOSS-TTS codec: resolve decode method across remote-code and vendored tokenizers ( #4760 )
...
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com >
2026-07-08 05:23:13 +00:00
Canlin Guo
a8b2bf11d2
[Feature] Support MOSS-TTS-Local-v1.5 Streaming ( #4804 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-07-03 16:00:30 +08:00
Zhou Taichang
a560ed184d
[Rebase] Rebase to vllm v0.24.0 ( #4709 )
2026-06-30 19:41:06 +08:00
Canlin Guo
2e6c83c89c
[Model] Support MOSS-TTS-local-v1.5 ( #4664 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-06-25 15:43:03 +08:00
Alex Brooks
465f1464d2
[Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager ( #3760 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-24 11:02:29 +08:00
Yueqian Lin
208932210f
[Chore][TTS] Reference recipes.vllm.ai recipes, remove dead code, and fix stale references ( #4567 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-06-19 15:05:26 +08:00
yangyonggit
63ba11b8b1
[Perf] Stacked audio ops: batched matmul and embedding gather in MOSS-TTS talker ( #4230 )
...
Signed-off-by: leo.yang <leo.yang.engineer@gmail.com >
2026-06-19 00:38:32 +00:00
yangyonggit and Yueqian Lin
1228a109f0
[Bugfix] MOSS-TTS: fix cross-request audio corruption under batching ( #4415 )
...
Signed-off-by: leo.yang <leo.yang.engineer@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-06-18 18:11:51 +00:00
akshatvishu
d8a72be206
fix(models): remove invalid sampling_metadata parameter from logits_processor ( #4456 )
...
Signed-off-by: akshatvishu <akshatnayak197@gmail.com >
2026-06-16 14:41:40 +08:00
yangyonggit
a3834e32cf
feat(moss-tts): add CUDA Graph support for codec decoder ( #4157 )
...
Signed-off-by: leo.yang <leo.yang.engineer@gmail.com >
2026-06-11 22:17:31 +00:00
Zhang Jian and Canlin Guo
b550709bba
[TTS][Model] support MOSS-TTS series ( #3420 )
...
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Signed-off-by: jian <jianmusings@gmail.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Canlin Guo <961750412@qq.com >
2026-06-02 15:46:01 +08:00