Yueqian Lin
fc81b8504a
feat(moss-tts-nano): add online serving, Gradio demo, and fix /v1/audio/speech integration
...
- Register moss_tts_nano as TTS model stage in serving_speech.py
(model detection, validation, prompt building)
- Fix registry mod_relname: moss_tts_nano -> modeling_moss_tts_nano
- Fix stage config: is_comprehension=true (required for generate task)
- Fix default mode: voice_clone -> continuation (built-in presets)
- Add compute_logits stub for VllmModelForTextGeneration protocol
- Remove unused _sentinel nn.Parameter
- Add Gradio demo with AudioWorklet streaming player (48kHz stereo)
- Add online/offline serving docs and launch scripts
TODO: Single-stage generation models don't support true streaming
(progressive audio chunks). Current TTFP = full generation time.
Needs multi-step scheduling support in GPUGenerationModelRunner.
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-14 13:06:44 -04:00
Yueqian Lin
da6b1b5741
feat(moss-tts-nano): add single-stage MOSS-TTS-Nano TTS support
...
Integrates OpenMOSS-Team/MOSS-TTS-Nano (0.1B) as a single
GPUGenerationWorker stage. Both the AR LM and MOSS-Audio-Tokenizer-Nano
codec run inside MossTTSNanoForGeneration.forward(), removing the need for
an inter-stage connector.
Key design choices:
- Weights loaded in load_weights() not __init__ (avoids pre-CUDA alloc)
- trust_remote_code delegates to upstream HF model classes
- codec path read from config.audio_tokenizer_pretrained_name_or_path
- inference_stream() collects progressive audio chunks for low latency
- 48 kHz stereo output; voice clone + continuation modes supported
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-14 13:06:12 -04:00
Yueqian Lin and SYLAR
a41174e083
[Model] VoxCPM2 native AR TTS support ( #2658 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: SYLAR <lishunyang12@users.noreply.github.com >
2026-04-11 10:21:26 +08:00
e2b0ee4b87
[Model] Add Dynin-omni model in vllm-omni ( #1759 )
...
Signed-off-by: kdg6245@snu.ac.kr <kdg6245@snu.ac.kr >
Signed-off-by: Yejoon Lee (IPAI) <leeyejoon@snu.ac.kr >
Signed-off-by: aidas (arpa-kt) <aidaslab@gmail.com >
Signed-off-by: Dogeun Kim <82812668+DOGEUNNKIM@users.noreply.github.com >
Co-authored-by: Yejoon Lee (IPAI) <leeyejoon@snu.ac.kr >
Co-authored-by: aidas (arpa-kt) <aidaslab@gmail.com >
2026-04-09 16:37:34 +08:00
Yueqian Lin
0e83ebe1d4
[OmniVoice] Add two-stage TTS serving support ( #2463 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-04-03 20:41:20 +00:00
Chen-Yo Sun
e9fe78e28c
[Model] Add Voxtral TTS model ( #1803 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-03-19 16:02:11 -04:00
Yueqian Lin
366b3368ea
Add Fish Speech S2 Pro support with online serving and voice cloning ( #1798 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-12 16:20:52 -04:00
汪志鹏
7271116973
[Bagel]: Support multistage img2img ( #1669 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-09 22:23:50 +08:00
dsinghvi and Hongsheng Liu
b63e7c7c9a
[Model] Fun cosy voice3-0.5-b-2512 ( #498 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-03-04 19:54:59 -05:00
1612948062
add support for MammothModa2 model ( #336 )
...
Signed-off-by: HonestDeng <2958906959@qq.com >
Signed-off-by: iwzbi <iwzbi@zju.edu.cn >
Signed-off-by: iwzbi <wzbi@zju.edu.cn >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: catcat <108673086+iwzbi@users.noreply.github.com >
Co-authored-by: iwzbi <iwzbi@zju.edu.cn >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-03-04 22:52:56 +08:00
usberkeley and princepride
84338494d2
[Model] Add Hunyuan Image3 AR Support ( #759 )
...
Signed-off-by: Bradley <bradley.b.pitt@gmail.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
2026-03-04 21:49:38 +08:00
+13
b19c227fb3
[New Model]: XiaomiMiMo/MiMo-Audio-7B-Instruct support ( #750 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: GG-li <3226868735@qq.com >
Signed-off-by: Sihao Li <111170255+GG-li@users.noreply.github.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Baoyuan Qi <qibaoyuan@126.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Signed-off-by: wuzhongjian <wuzhongjian_yewu@cmss.chinamobile.com >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
Signed-off-by: baoyuan qi <qibaoyuan@126.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Prajwal A <prajwalanagani@gmail.com >
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Signed-off-by: 丁宁 <nndding@gmail.com >
Signed-off-by: SHIJIN ZHANG <75300765+Dovis01@users.noreply.github.com >
Signed-off-by: dingning<dingning7@xiaomi.com >
Signed-off-by: dingning <dingning7@xiaomi.com >
Signed-off-by: dingning <dingning@xiaomi.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Zhang Shijin <zhangshijin@xiaomi.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Sihao Li <111170255+GG-li@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: JohnJan <wuzhongjian_yewu@cmss.chinamobile.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
Co-authored-by: shijin zhang <zsj1364226740@gmail.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
Co-authored-by: Prajwal A <34590600+LawJarp-A@users.noreply.github.com >
Co-authored-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: dingning <dingning7@xiaomi.com >
Co-authored-by: ning ding <nndding@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-27 11:19:49 +08:00
4146095623
[Perf] GLM Image ( #920 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: Jared Wen <w13431838023@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-27 10:29:14 +08:00
Sy03 and Hongsheng Liu
efbe4116ff
[Feature] : Support disaggregated inference pipeline for Qwen3_TTS ( #1161 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-21 07:36:44 +08:00
汪志鹏 and wzliu
7f821be57b
Support Bagel Model ( #726 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: wzliu <wzliu@connect.hku.hk >
2026-01-22 23:09:55 +13:00
Gao Han
a54c323952
[Model] Support Qwen3-TTS model series ( #895 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-22 16:57:37 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
R2-Y and Rein
0a4e5a8710
[Feature] add support for Qwen3-omni ( #55 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein <rein@Reins-MacBook-Air.local >
2025-11-30 04:44:01 +08:00
Gao Han
598b4ddb51
[Feature] support multimodal inputs with multiple requests ( #76 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-24 16:02:44 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
Gaohan123
22f36de34e
fix error
2025-10-24 16:21:52 +08:00
Gaohan123
eafc7c44c3
fix error for pre-commit
2025-10-24 16:21:50 +08:00
Yueqian Lin