Yueqian Lin
fc81b8504a
feat(moss-tts-nano): add online serving, Gradio demo, and fix /v1/audio/speech integration
- Register moss_tts_nano as TTS model stage in serving_speech.py
(model detection, validation, prompt building)
- Fix registry mod_relname: moss_tts_nano -> modeling_moss_tts_nano
- Fix stage config: is_comprehension=true (required for generate task)
- Fix default mode: voice_clone -> continuation (built-in presets)
- Add compute_logits stub for VllmModelForTextGeneration protocol
- Remove unused _sentinel nn.Parameter
- Add Gradio demo with AudioWorklet streaming player (48kHz stereo)
- Add online/offline serving docs and launch scripts
TODO: Single-stage generation models don't support true streaming
(progressive audio chunks). Current TTFP = full generation time.
Needs multi-step scheduling support in GPUGenerationModelRunner.
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-04-14 13:06:44 -04:00
..
2026-04-10 16:48:06 +08:00
2025-12-27 01:59:33 +13:00
2026-04-14 14:20:38 +08:00
2026-04-11 02:11:31 +08:00
2026-03-13 17:11:06 +08:00
2026-03-30 21:27:09 +08:00
2026-04-12 00:14:16 -04:00
2026-03-25 19:02:48 +00:00
2026-04-14 13:06:44 -04:00
2026-04-14 14:20:38 +08:00
2026-03-13 17:11:06 +08:00
2026-03-13 17:11:06 +08:00
2026-03-11 23:48:41 -04:00
2026-04-12 00:14:16 -04:00
2026-04-14 14:20:38 +08:00