vllm-omni

attention

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546 )

2026-09-16 11:38:06 -07:00

benchmarks

# [Bugfix] Replace ffmpeg subprocess with PyAV to avoid HEVC decoder hang (#7364 ) (#7504 )

2026-09-20 14:37:09 +00:00

clients

[Core] Give the OpenAI Realtime wire codec a reusable home (RFC #6592 P0a) (#7640 )

2026-09-17 02:33:40 -07:00

config

[LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648 )

2026-09-21 06:12:45 +00:00

core

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

deploy

[LingBot World] Shard the streaming VAE decode across the Ulysses ranks (#7651 )

2026-09-21 19:00:46 +08:00

diffusion

[Model] Enable online FP8 linears for LingBot World (#7549 )

2026-09-21 12:21:46 +00:00

distributed

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

engine

Merge main and preserve dispatch backlog across monitor windows

2026-09-21 17:13:27 +08:00

entrypoints

Merge main and preserve dispatch backlog across monitor windows

2026-09-21 17:13:27 +08:00

experimental

[LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648 )

2026-09-21 06:12:45 +00:00

host_weight_runtime

[Bugfix][Core] Clean up failed HWR atomic metadata writes (#6956 )

2026-09-11 09:03:26 +08:00

inputs

[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759 )

2026-09-15 20:43:30 -07:00

lora

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758 )

2026-01-27 10:22:40 +08:00

metrics

[Bugfix] Register statistics for dynamically added replicas (#7298 )

2026-09-19 17:07:14 +00:00

model_executor

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

model_extras

[Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047 )

2026-09-14 10:02:30 -07:00

outputs

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

platforms

[Performance] Capture MOSS-TTS codec streaming decode with NPUGraph (#7280 )

2026-09-21 06:38:23 +08:00

plugins

[Quantization] Migrate GGUF diffusion model support to OOT plugin (#4769 )

2026-07-11 18:48:43 +00:00

profiler

[Enhancement]modify profiling.md (#3051 )

2026-04-24 16:30:24 +08:00

protocol

[Core] Give the OpenAI Realtime wire codec a reusable home (RFC #6592 P0a) (#7640 )

2026-09-17 02:33:40 -07:00

quantization

[Bugfix][Ascend NPU][Diffusion] Load over-wide unquantized fallback weights straight into host memory under DLOFix/mxfp online offload after quant (#7009 )

2026-09-18 07:36:48 +00:00

reasoning

[Rebase] Rebase to vLLM 0.29.0 (#7230 )

2026-09-10 12:08:28 +08:00

sample

update dirs

2025-09-11 15:43:43 +08:00

tokenizers

[Fix] Restore MammothModa2 support (#6694 )

2026-08-28 08:32:32 +08:00

transformers_utils

[Misc] Remove Dynin-Omni and dots.tts support (#7655 )

2026-09-20 00:28:29 -07:00

utils

[Frontend] Scale Omni serving across API processes (#6923 )

2026-09-16 22:29:31 -07:00

worker

Merge main and preserve dispatch backlog across monitor windows

2026-09-21 17:13:27 +08:00

worker_v2

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

__init__.py

[Rebase] Rebase to vllm 0.26.0 (#5443 )

2026-07-27 23:35:49 +08:00

data_entry_keys.py

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

errors.py

[refactor] Refactor guardrail error handling - add 400 error code (#4297 )

2026-06-11 21:09:24 +00:00

logger.py

[BugFix] Failed to print DEBUG level log (#307 )

2025-12-15 07:13:36 +00:00

patch.py

[Rebase] Rebase to vllm 0.27.0 (#5976 )

2026-08-11 15:23:46 +00:00

request.py

[Rebase] Rebase to vllm 0.28.0 (#6606 )

2026-08-27 06:12:55 +00:00

version.py

[Misc] Warn When vLLM / vLLM-Omni Have Mismatched Versions (#2691 )

2026-04-17 20:15:16 +08:00