Files
vllm-omni/vllm_omni/deploy/edge/hardware/x86_cpu.yaml
T

10 lines
269 B
YAML
Raw Normal View History

# x86 mini-PC / laptop CPU: eager, 1-2 utterances, thread ranges derived at runtime.
stages:
- stage_id: 0
max_num_seqs: 2
enforce_eager: true
async_scheduling: false
- stage_id: 1
max_num_seqs: 2
enforce_eager: true
async_scheduling: false