995 B
995 B
Configuration Options
This section lists the most common options for running vLLM-Omni.
For options within a vLLM Engine. Please refer to vLLM Configuration
Currently, the main options are maintained by stage configs for each model.
For specific example, please refer to Qwen2.5-omni stage config
For introduction, please check Introduction for stage config
Optimization Features
- TeaCache Configuration - Enable TeaCache adaptive caching for DiT models to achieve 1.5x-2.0x speedup with minimal quality loss
- Cache-DiT Configuration - Enable Cache-DiT as cache acceleration backends for DiT models
- Parallelism Configuration - Enable parallelism (e.g., sequence parallelism) for for DiT models