0 Fork 0

Files

T

tzhouamandClaude Fable 5.1 536866b916 [Edge] Classify and document the edge env vars; fix the client decoder call

- environment_variable_inventory: VLLM_OMNI_CPU_INDUCTOR / HW_PROFILE /
  INIT_TIMELINE / STEP_STATS_DIR (public), STAGE_ID / INIT_TIMELINE_DIR
  (internal); reference page rows added.
- edge_decoder_client.LocalDecoder: batched_chunked_decode takes a [B, Q, F]
  tensor, not a list (the WP5 e2e run failed with a TypeError); the decoder
  now also carries the ramp schedule attributes the Code2Wav stage sets.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-09 15:22:52 +08:00

composable_parallel.md

[Docs] Remove stale stage config references (#6270 )

2026-08-20 07:09:12 +08:00

environment_variables.md

[Edge] Classify and document the edge env vars; fix the client decoder call

2026-09-09 15:22:52 +08:00

gpu_memory_utilization.md

[Docs] Remove stale stage config references (#6270 )

2026-08-20 07:09:12 +08:00

README.md

[Doc] Update README and docs for v0.28.0 (#6858 )

2026-09-01 19:50:26 +08:00

stage_configs.md

[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284 )

2026-08-27 08:21:03 +00:00

README.md

Configuration Options

This section lists the most common options for running vLLM-Omni.

For options within a vLLM Engine, please refer to the vLLM 0.28 configuration guide.

Each model defines fixed topology in a registered PipelineConfig and runtime overrides in a deploy YAML.

For process-level settings shared by the CLI, deploy YAML, workers, and model integrations, see Environment Variables.

For a specific example, see the Qwen2.5-Omni deploy config. The matching frozen pipeline topology lives at vllm_omni/model_executor/models/qwen2_5_omni/pipeline.py.

For an introduction, see Pipeline and deploy configurations.

Memory Configuration

GPU Memory Calculation and Configuration - Guide on how to calculate memory requirements and set up gpu_memory_utilization for optimal performance

Optimization Features

Diffusion Features Overview - Complete overview of all diffusion model features and supported models