[Config Refactor] Migrate 5 TTS models (VoxCPM2 / CosyVoice3 / MiMo Audio / Voxtral TTS / Fish Speech S2 Pro) to Pipeline + Deploy schema (#2958)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>

docs/user_guide/examples/offline_inference/cosyvoice3.md

@@ -61,10 +61,17 @@ Key components live in `vllm_omni/model_executor/models/cosyvoice3/cosyvoice3.py
     - Stage 0 uses `CosyVoice3LM` and outputs speech tokens + conditioning features.
     - Stage 1 runs the flow model (DiT-based CFM) and HiFiGAN to synthesize waveform.
 
-Stage wiring is configured in `vllm_omni/model_executor/stage_configs/cosyvoice3.yaml`.
+Pipeline topology lives in `vllm_omni/model_executor/models/cosyvoice3/pipeline.py`;
+runtime tunables (batch size, memory limits, sampling) live in
+`vllm_omni/deploy/cosyvoice3.yaml`. The deploy config auto-loads by
+HF `model_type` and defaults to `async_chunk: true` (shared-memory
+streaming). Pass `--no-async-chunk` on `vllm serve` to switch to the
+legacy sync path where stage 1 runs `text2flow` over the full
+speech-token sequence.
 
 - Stage 0 emits latent speech tokens.
-- Stage 1 consumes them via `custom_process_input_func` and outputs audio.
+- Stage 1 consumes them via `sync_process_input_func` (sync mode) or the
+  shared-memory connector (async-chunk mode) and outputs audio.
 
 ## Example materials
 

docs/user_guide/examples/offline_inference/mimo_audio.md

@@ -38,7 +38,6 @@ Run a single sample for basic TTS:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft
 ```
@@ -47,7 +46,6 @@ Run batch samples for basic TTS:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft \
   --num-prompts {batch_size}
@@ -65,7 +63,6 @@ Generate speech from text input:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft \
   --text "The weather is so nice today."
@@ -77,7 +74,6 @@ Generate speech with explicit voice style instructions:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft_with_instruct \
   --text "The weather is so nice today." \
@@ -90,7 +86,6 @@ Generate speech using an audio reference for voice cloning:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft_with_audio \
   --text "The weather is so nice today." \
@@ -103,7 +98,6 @@ Generate speech from text containing natural voice descriptions:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type tts_sft_with_natural_instruction \
   --text "In a panting young male voice, he said: I can't run anymore, wait for me!"
@@ -115,7 +109,6 @@ Transcribe audio to text:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type audio_trancribing_sft \
   --audio-path "./spoken_dialogue_assistant_turn_1.wav"
@@ -127,7 +120,6 @@ Understand and analyze audio content with text queries:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type audio_understanding_sft \
   --text "Summarize the audio." \
@@ -140,7 +132,6 @@ Audio understanding with reasoning chain:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type audio_understanding_sft_with_thinking \
   --text "Summarize the audio." \
@@ -153,7 +144,6 @@ Multi-turn dialogue with audio input and output:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type spoken_dialogue_sft_multiturn \
   --audio-path "./prompt_speech_zh_m.wav"
@@ -167,7 +157,6 @@ Multi-turn dialogue converting speech to text:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type speech2text_dialogue_sft_multiturn
 ```
@@ -180,7 +169,6 @@ Multi-turn text-only dialogue:
 
 ```bash
 python3 -u end2end.py \
-  --stage-configs-path vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
   --model-name XiaomiMiMo/MiMo-Audio-7B-Instruct \
   --query-type text_dialogue_sft_multiturn
 ```

docs/user_guide/examples/offline_inference/voxtral_tts.md

@@ -13,28 +13,24 @@ When `mistral_common` has `SpeechRequest` support, prompt token IDs are built vi
 ```bash
 # Basic single-prompt with cheerful_female voice preset
 python3 examples/offline_inference/voxtral_tts/end2end.py \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/voxtral_tts.yaml \
     --write-audio --voice cheerful_female \
     --model mistralai/Voxtral-4B-TTS-2603 \
     --text "That eerie silence after the first storm was just the calm before another round of chaos, wasn't it?"
 
 # 32 replicate prompts with cheerful_female voice preset
 python3 examples/offline_inference/voxtral_tts/end2end.py \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/voxtral_tts.yaml \
     --num-prompts 32 --write-audio --voice cheerful_female \
     --model mistralai/Voxtral-4B-TTS-2603 \
     --text "That eerie silence after the first storm was just the calm before another round of chaos, wasn't it?"
 
 # Streaming with neutral_female voice preset
 python3 examples/offline_inference/voxtral_tts/end2end.py \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/voxtral_tts.yaml \
     --streaming --write-audio --voice neutral_female \
     --model mistralai/Voxtral-4B-TTS-2603 \
     --text "That eerie silence after the first storm was just the calm before another round of chaos, wasn't it?"
 
 # 32 prompts, 8 concurrent requests per wave, streaming with neutral_female voice
 python3 examples/offline_inference/voxtral_tts/end2end.py \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/voxtral_tts.yaml \
     --num-prompts 32 --concurrency 8 --streaming --write-audio --voice neutral_female \
     --model mistralai/Voxtral-4B-TTS-2603 \
     --text "That eerie silence after the first storm was just the calm before another round of chaos, wasn't it?"
@@ -42,7 +38,6 @@ python3 examples/offline_inference/voxtral_tts/end2end.py \
 # Short debug prompt with reference audio
 # Note: Reference audio capability is not yet released.
 python3 examples/offline_inference/voxtral_tts/end2end.py \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/voxtral_tts.yaml \
     --write-audio \
     --model mistralai/Voxtral-4B-TTS-2603 \
     --text "This is a test message." \
@@ -57,7 +52,7 @@ python3 examples/offline_inference/voxtral_tts/end2end.py \
 | `--text TEXT` | Text to synthesize (default: `"This is a test message."`) |
 | `--audio-path PATH` | Path to reference audio file for voice cloning |
 | `--output-dir DIR` | Directory to write output WAV files (default: `output_audio`) |
-| `--stage-configs-path PATH` | Path to stage configs YAML (currently it must be set for VoxtralTTS) |
+| `--deploy-config PATH` | Override the deploy config path. If unset, auto-loads `vllm_omni/deploy/voxtral_tts.yaml` from the HF `model_type`. |
 | `--num-prompts N` | Number of replicate prompts to run for measuring performance (default: 1) |
 | `--streaming` | Use streaming generation via `AsyncOmni` (default: blocking `Omni`) |
 | `--concurrency N` | Max concurrent requests per wave (must be used with `--streaming`, must evenly divide `--num-prompts`) |

docs/user_guide/examples/online_serving/fish_speech.md

@@ -41,15 +41,11 @@ Features:
 ## Launch the Server
 
 ```bash
-vllm-omni serve fishaudio/s2-pro \
-    --stage-configs-path vllm_omni/model_executor/stage_configs/fish_speech_s2_pro.yaml \
-    --omni \
-    --port 8091 \
-    --trust-remote-code \
-    --enforce-eager \
-    --gpu-memory-utilization 0.9
+vllm serve fishaudio/s2-pro --omni --port 8091
 ```
 
+The deploy config is auto-loaded from `vllm_omni/deploy/fish_qwen3_omni.yaml`.
+
 Or use the convenience script:
 
 ```bash

docs/user_guide/examples/online_serving/mimo_audio.md

@@ -13,10 +13,10 @@ Please refer to [README.md](https://github.com/vllm-project/vllm-omni/tree/main/
 ```bash
 export MIMO_AUDIO_TOKENIZER_PATH="XiaomiMiMo/MiMo-Audio-Tokenizer"
 
-vllm-omni serve XiaomiMiMo/MiMo-Audio-7B-Instruct --omni \
---served-model-name "MiMo-Audio-7B-Instruct"  \
---port 18091 --stage-configs-path ./vllm_omni/model_executor/stage_configs/mimo_audio.yaml \
---chat-template ./examples/online_serving/mimo_audio/chat_template.jinja
+vllm serve XiaomiMiMo/MiMo-Audio-7B-Instruct --omni \
+    --served-model-name "MiMo-Audio-7B-Instruct" \
+    --port 18091 \
+    --chat-template ./examples/online_serving/mimo_audio/chat_template.jinja
 ```
 > ⚠️ **Important**  
 > **MiMo-Audio is not compatible with the default chat template.**