3 people 470ec60848 [Core] Refactor omni prefix cache into Manager/Controller (#6654) ...

Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-09-19 21:23:59 +08:00

..

attention

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546)

2026-09-16 11:38:06 -07:00

benchmarks

[Bugfix] Preserve benchmark metric sample counts in results (#7624)

2026-09-16 08:39:01 -07:00

clients

[Core] Give the OpenAI Realtime wire codec a reusable home (RFC #6592 P0a) (#7640)

2026-09-17 02:33:40 -07:00

config

[Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134)

2026-09-18 13:29:18 -07:00

core

[Core] Refactor omni prefix cache into Manager/Controller (#6654)

2026-09-19 21:23:59 +08:00

deploy

[Core] Refactor omni prefix cache into Manager/Controller (#6654)

2026-09-19 21:23:59 +08:00

diffusion

[Refactor][Diffusion] Resolve distributed layerwise topology in the plan (#7326)

2026-09-19 19:05:18 +08:00

distributed

[CI/Build][MiniCPM-o] Fix the Nightly tests (#7758)

2026-09-18 08:58:33 +00:00

engine

[Bugfix][Core] Apply Realtime item truncation once per command (#7800)

2026-09-18 18:59:09 +00:00

entrypoints

[Hardware][Ascend] Integrate MindIE dense and sparse quantized attention for Wan2.2 T2V (#7561)

2026-09-18 01:28:27 +00:00

experimental

[XPU][Bugfix] Make AR-Diffusion KV preallocation device-agnostic (#7777)

2026-09-18 14:41:41 -05:00

host_weight_runtime

[Bugfix][Core] Clean up failed HWR atomic metadata writes (#6956)

2026-09-11 09:03:26 +08:00

inputs

[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)

2026-09-15 20:43:30 -07:00

lora

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)

2026-01-27 10:22:40 +08:00

metrics

[Feature][TTS] Add Speech API streaming metrics (#6853)

2026-09-11 21:22:15 +08:00

model_executor

[Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134)

2026-09-18 13:29:18 -07:00

model_extras

[Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047)

2026-09-14 10:02:30 -07:00

outputs

[Bugfix] Per-key accumulation strategy for Qwen3-TTS codec frame outputs (#7608)

2026-09-15 20:08:49 -07:00

platforms

[Core] Refactor omni prefix cache into Manager/Controller (#6654)

2026-09-19 21:23:59 +08:00

plugins

[Quantization] Migrate GGUF diffusion model support to OOT plugin (#4769)

2026-07-11 18:48:43 +00:00

profiler

[Enhancement]modify profiling.md (#3051)

2026-04-24 16:30:24 +08:00

protocol

[Core] Give the OpenAI Realtime wire codec a reusable home (RFC #6592 P0a) (#7640)

2026-09-17 02:33:40 -07:00

quantization

[Bugfix][Ascend NPU][Diffusion] Load over-wide unquantized fallback weights straight into host memory under DLOFix/mxfp online offload after quant (#7009)

2026-09-18 07:36:48 +00:00

reasoning

[Rebase] Rebase to vLLM 0.29.0 (#7230)

2026-09-10 12:08:28 +08:00

sample

update dirs

2025-09-11 15:43:43 +08:00

tokenizers

[Fix] Restore MammothModa2 support (#6694)

2026-08-28 08:32:32 +08:00

transformers_utils

[Model] Add Tencent AuK speech generation and editing (encoder + diffusion pipeline) (#7385)

2026-09-11 20:09:58 +00:00

utils

[Frontend] Scale Omni serving across API processes (#6923)

2026-09-16 22:29:31 -07:00

worker

[Core] Refactor omni prefix cache into Manager/Controller (#6654)

2026-09-19 21:23:59 +08:00

__init__.py

[Rebase] Rebase to vllm 0.26.0 (#5443)

2026-07-27 23:35:49 +08:00

data_entry_keys.py

[Perf][NemotronVoiceChat] Fast defaults for all three deploy profiles: 2.8x offline, realtime full-duplex audio (#6354)

2026-09-03 18:49:19 -07:00

errors.py

[refactor] Refactor guardrail error handling - add 400 error code (#4297)

2026-06-11 21:09:24 +00:00

logger.py

[BugFix] Failed to print DEBUG level log (#307)

2025-12-15 07:13:36 +00:00

patch.py

[Rebase] Rebase to vllm 0.27.0 (#5976)

2026-08-11 15:23:46 +00:00

request.py

[Rebase] Rebase to vllm 0.28.0 (#6606)

2026-08-27 06:12:55 +00:00

version.py

[Misc] Warn When vLLM / vLLM-Omni Have Mismatched Versions (#2691)

2026-04-17 20:15:16 +08:00