Signed-off-by: Rein Yang <ruiruyang2@gmail.com> Signed-off-by: root <root@hk01dgx028.cm.cluster> Co-authored-by: root <root@hk01dgx028.cm.cluster>
21 lines
692 B
Markdown
21 lines
692 B
Markdown
# Adding a New Model
|
|
|
|
This section provides comprehensive guidance on how to add a new model to vLLM-Omni.
|
|
|
|
## Documentation
|
|
|
|
- **[Adding a New Model Guide](adding_multi_stage_model.md)**: Complete step-by-step guide using Qwen3-Omni as an example
|
|
|
|
The guide covers:
|
|
- Directory structure and organization
|
|
- Implementing stage components (thinker, talker, code2wav)
|
|
- Creating the unified model class
|
|
- Model registration
|
|
- Stage configuration
|
|
- Stage input processors
|
|
- Testing strategies
|
|
|
|
## Quick Start
|
|
|
|
For a quick reference, see the [Adding a New Model Guide](adding_multi_stage_model.md) which walks through the complete implementation of Qwen3-Omni, a multi-stage omni-modality model.
|