vllm-omni/examples/online_serving/ming_flash_omni_tts

Ming-flash-omni Standalone TTS (Online Serving)

This directory contains online e2e examples for Ming-flash-omni-2.0 standalone talker deployment.

Server uses:

• model: Jonathan1909/Ming-flash-omni-2.0
• stage config: vllm_omni/model_executor/stage_configs/ming_flash_omni_tts.yaml

Launch the Server

# from repo root
bash examples/online_serving/ming_flash_omni_tts/run_server.sh

Equivalent manual command:

vllm serve Jonathan1909/Ming-flash-omni-2.0 \
    --stage-configs-path vllm_omni/model_executor/stage_configs/ming_flash_omni_tts.yaml \
    --host 0.0.0.0 \
    --port 8091 \
    --trust-remote-code \
    --omni

Send TTS Request

Python client:

python examples/online_serving/ming_flash_omni_tts/speech_client.py \
    --text "我们当迎着阳光辛勤耕作，去摘取，去制作，去品尝，去馈赠。" \
    --output ming_online.wav

Long-form instructions (e.g. ASMR whisper style) via the client:

python examples/online_serving/ming_flash_omni_tts/speech_client.py \
    --text "我会一直在这里陪着你，直到你慢慢、慢慢地沉入那个最温柔的梦里……好吗？" \
    --instructions "这是一种ASMR耳语，属于一种旨在引发特殊感官体验的创意风格。这个女性使用轻柔的普通话进行耳语，声音气音成分重。音量极低，紧贴麦克风，语速极慢，旨在制造触发听者颅内快感的声学刺激。" \
    --output ming_online_asmr.wav

Notes

• This is the online serving counterpart of examples/offline_inference/ming_flash_omni_tts/.
• The server uses use_zero_spk_emb=True and the default decode args (max_decode_steps=200, cfg=2.0, sigma=0.25, temperature=0.0). For other caption fields (语速, 基频, IP, BGM, etc.) or overriding decode args, use the offline e2e example where additional_information is set explicitly.