Yueqian Lin
fc81b8504a
feat(moss-tts-nano): add online serving, Gradio demo, and fix /v1/audio/speech integration
- Register moss_tts_nano as TTS model stage in serving_speech.py
(model detection, validation, prompt building)
- Fix registry mod_relname: moss_tts_nano -> modeling_moss_tts_nano
- Fix stage config: is_comprehension=true (required for generate task)
- Fix default mode: voice_clone -> continuation (built-in presets)
- Add compute_logits stub for VllmModelForTextGeneration protocol
- Remove unused _sentinel nn.Parameter
- Add Gradio demo with AudioWorklet streaming player (48kHz stereo)
- Add online/offline serving docs and launch scripts
TODO: Single-stage generation models don't support true streaming
(progressive audio chunks). Current TTFP = full generation time.
Needs multi-step scheduling support in GPUGenerationModelRunner.
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-04-14 13:06:44 -04:00
..
2026-04-13 11:15:49 +00:00
2026-04-11 02:11:31 +08:00
2026-03-18 17:33:53 +08:00
2026-04-09 16:37:34 +08:00
2026-04-09 20:34:34 +00:00
2026-03-29 15:56:51 +00:00
2026-03-29 06:35:56 +00:00
2026-03-24 13:00:21 +08:00
2026-04-12 22:06:49 +08:00
2026-04-13 14:20:04 +08:00
2026-04-09 06:52:12 +00:00
2026-03-19 12:26:12 +08:00
2026-04-11 02:11:31 +08:00
2026-04-14 13:06:44 -04:00
2026-04-11 02:11:31 +08:00
2026-04-11 02:11:31 +08:00
2026-04-11 02:11:31 +08:00
2026-03-28 07:03:17 +08:00
2026-04-14 15:05:12 +08:00
2026-04-12 00:48:47 +08:00
2026-04-09 06:52:12 +00:00
2026-04-02 15:42:50 +08:00
2026-04-14 09:16:47 +12:00
2026-03-25 01:20:32 +00:00
2026-04-12 22:06:49 +08:00