Signed-off-by: Rein Yang <ruiruyang2@gmail.com> Signed-off-by: root <root@hk01dgx028.cm.cluster> Co-authored-by: root <root@hk01dgx028.cm.cluster>
692 B
692 B
Adding a New Model
This section provides comprehensive guidance on how to add a new model to vLLM-Omni.
Documentation
- Adding a New Model Guide: Complete step-by-step guide using Qwen3-Omni as an example
The guide covers:
- Directory structure and organization
- Implementing stage components (thinker, talker, code2wav)
- Creating the unified model class
- Model registration
- Stage configuration
- Stage input processors
- Testing strategies
Quick Start
For a quick reference, see the Adding a New Model Guide which walks through the complete implementation of Qwen3-Omni, a multi-stage omni-modality model.