Files
vllm-omni/docs/design/module/model_integration.md
2026-08-10 19:25:03 +08:00

1.6 KiB

title, kind, status, owners, primary_code_paths, primary_code_path_owners, related_code_paths, depends_on, validation_paths, upstream_refs, last_reviewed
title kind status owners primary_code_paths primary_code_path_owners related_code_paths depends_on validation_paths upstream_refs last_reviewed
Model Integration module draft
@tzhouam
@gcanlin
vllm_omni/model_executor/**
vllm_omni/model_extras/**
vllm_omni/plugins/**
paths owners
vllm_omni/model_executor/models/**
@Sy0307
@amy-why-3459
@linyueqian
vllm_omni/transformers_utils/**
vllm_omni/tokenizers/**
input_output_modality_contracts.md
ar_runtime.md
tests/model_executor/**
tests/model_extras/**
tests/plugin/**
vllm.model_executor
2026-07-16

Model integration

Model integration adapts model-specific configuration, preprocessing, loading, and execution behavior to stable runtime contracts.

Candidate invariants

MODEL-INV-001: Registration is explicit

Rule: A model integration MUST declare how its model class, loader, input processor, and stage configuration are selected.

MODEL-INV-002: Model code does not route stages

Rule: Model-specific code MUST NOT select or invoke a downstream omni stage.

MODEL-INV-003: Upstream behavior is reused deliberately

Rule: An upstream vLLM implementation SHOULD be reused when its contract is sufficient; an override MUST document the behavioral difference.

Safe-change guide

Test registration, checkpoint loading, input conversion, and representative model execution. Test shared utilities against more than one integration.