Yueqian Lin
b03a41a7f9
Follow-up to #2958. MOSS-TTS-Nano was authored before the schema refactor and still shipped as a legacy stage_configs yaml; this aligns it with the same layout the 5 migrated TTS models now use. - vllm_omni/model_executor/models/moss_tts_nano/pipeline.py declares MOSS_TTS_NANO_PIPELINE (single LLM_AR stage, owns_tokenizer, audio output, stop_token_ids=[2] as a hard EOS backstop). - vllm_omni/deploy/moss_tts_nano.yaml holds runtime knobs (max_num_seqs, gpu_memory_utilization, enforce_eager, default_sampling_params, skip_mm_profiling); trust_remote_code stays at deploy top-level. - vllm_omni/config/pipeline_registry.py registers the entry so the lazy registry can resolve it. - moss_tts_nano/__init__.py exports MossTTSNanoForGeneration (VoxCPM2 pattern). - Removed vllm_omni/model_executor/stage_configs/moss_tts_nano.yaml. Examples, shell scripts, READMEs, and buildkite-invoked tests are updated to use `vllm serve <model> --omni` / `--deploy-config` (auto-load kicks in; no --stage-configs-path or --trust-remote-code). Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
20 lines
386 B
Bash
Executable File
20 lines
386 B
Bash
Executable File
#!/bin/bash
|
|
# Launch vLLM-Omni server for MOSS-TTS-Nano
|
|
#
|
|
# Usage:
|
|
# ./run_server.sh
|
|
# CUDA_VISIBLE_DEVICES=0 PORT=8091 ./run_server.sh
|
|
|
|
set -e
|
|
|
|
MODEL="${MODEL:-OpenMOSS-Team/MOSS-TTS-Nano}"
|
|
PORT="${PORT:-8091}"
|
|
|
|
echo "Starting MOSS-TTS-Nano server with model: $MODEL"
|
|
|
|
FLASHINFER_DISABLE_VERSION_CHECK=1 \
|
|
vllm serve "$MODEL" \
|
|
--host 0.0.0.0 \
|
|
--port "$PORT" \
|
|
--omni
|