Configuration Options
This section lists the most common options for running vLLM-Omni.
For options within a vLLM Engine. Please refer to vLLM Configuration
Currently, the main options are maintained by stage configs for each model.
For specific example, please refer to Qwen2.5-omni stage config
For introduction, please check Introduction for stage config
Optimization Features
- TeaCache Configuration - Enable TeaCache adaptive caching for DiT models to achieve 1.5x-2.0x speedup with minimal quality loss