54 lines
1.9 KiB
Markdown
54 lines
1.9 KiB
Markdown
|
# Ming-flash-omni Standalone TTS (Online Serving)
|
||
|
|
|
||
|
|
This directory contains online e2e examples for **Ming-flash-omni-2.0 standalone talker deployment**.
|
||
|
|
|
||
|
|
Server uses:
|
||
|
|
|
||
|
|
- `model`: `Jonathan1909/Ming-flash-omni-2.0`
|
||
|
|
- `stage config`: `vllm_omni/model_executor/stage_configs/ming_flash_omni_tts.yaml`
|
||
|
|
|
||
|
|
## Launch the Server
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# from repo root
|
||
|
|
bash examples/online_serving/ming_flash_omni_tts/run_server.sh
|
||
|
|
```
|
||
|
|
|
||
|
|
Equivalent manual command:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
vllm serve Jonathan1909/Ming-flash-omni-2.0 \
|
||
|
|
--stage-configs-path vllm_omni/model_executor/stage_configs/ming_flash_omni_tts.yaml \
|
||
|
|
--host 0.0.0.0 \
|
||
|
|
--port 8091 \
|
||
|
|
--trust-remote-code \
|
||
|
|
--omni
|
||
|
|
```
|
||
|
|
|
||
|
|
## Send TTS Request
|
||
|
|
|
||
|
|
Python client:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python examples/online_serving/ming_flash_omni_tts/speech_client.py \
|
||
|
|
--text "我们当迎着阳光辛勤耕作，去摘取，去制作，去品尝，去馈赠。" \
|
||
|
|
--output ming_online.wav
|
||
|
|
```
|
||
|
|
|
||
|
|
Long-form `instructions` (e.g. ASMR whisper style) via the client:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python examples/online_serving/ming_flash_omni_tts/speech_client.py \
|
||
|
|
--text "我会一直在这里陪着你，直到你慢慢、慢慢地沉入那个最温柔的梦里……好吗？" \
|
||
|
|
--instructions "这是一种ASMR耳语，属于一种旨在引发特殊感官体验的创意风格。这个女性使用轻柔的普通话进行耳语，声音气音成分重。音量极低，紧贴麦克风，语速极慢，旨在制造触发听者颅内快感的声学刺激。" \
|
||
|
|
--output ming_online_asmr.wav
|
||
|
|
```
|
||
|
|
|
||
|
|
## Notes
|
||
|
|
|
||
|
|
- This is the **online serving** counterpart of `examples/offline_inference/ming_flash_omni_tts/`.
|
||
|
|
- The server uses `use_zero_spk_emb=True` and the default decode args
|
||
|
|
(`max_decode_steps=200`, `cfg=2.0`, `sigma=0.25`, `temperature=0.0`).
|
||
|
|
For other caption fields (`语速`, `基频`, `IP`, BGM, etc.) or overriding
|
||
|
|
decode args, use the offline e2e example where `additional_information`
|
||
|
|
is set explicitly.
|