Files
vllm-omni/docs/design/module/vllm_omni_config.md
T
2026-07-16 12:08:45 +08:00

1.2 KiB

title, kind, status, owners, primary_code_paths, related_code_paths, depends_on, validation_paths, upstream_refs, last_reviewed
title kind status owners primary_code_paths related_code_paths depends_on validation_paths upstream_refs last_reviewed
vLLM-Omni Configuration module draft
@lishunyang12
@alex-jw-brooks
vllm_omni/config/**
vllm_omni/deploy/**
vllm_omni/model_executor/stage_configs/**
vllm_omni/platforms/*/stage_configs/**
tests/config/**
vllm.config
2026-07-16

vLLM-Omni configuration

Configuration defines how user input becomes validated engine, stage, deployment, and platform settings.

Candidate invariants

CONFIG-INV-001: Configuration is validated before startup

Rule: Invalid stage graphs, resource assignments, and incompatible options MUST fail before managed runtime processes start.

CONFIG-INV-002: Precedence is deterministic

Rule: Defaults, files, environment variables, and CLI overrides MUST have a documented and deterministic precedence.

CONFIG-INV-003: Runtime modules consume validated configuration

Rule: Runtime modules MUST NOT independently reinterpret raw user configuration.

Safe-change guide

Test defaults, parsing, override precedence, serialization, invalid combinations, and representative multi-stage configurations.