vllm-omni

attention

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546 )

2026-09-16 11:38:06 -07:00

benchmarks

[CI/Build] Fix Qwen3-Omni Talker benchmark workload (#8057 )

2026-09-24 23:56:53 +08:00

clients

[Bugfix] Fix Nemotron VoiceChat duplex nightly handshake (#7884 )

2026-09-25 17:25:15 +00:00

config

feat(cosyvoice3): GPU-resident F0 predictor & pure-PyTorch vocoder (Task C2) (#7518 )

2026-09-28 23:13:43 +08:00

core

[Performance][MiniCPM-o] Zero-copy block-aligned KV sliding window with in-place Re-RoPE for duplex Stage-0 (#7821 )

2026-09-28 10:11:54 +08:00

deploy

[Perf][PersonaPlex] Serve 16 concurrent realtime duplex sessions on one GPU (#8192 )

2026-09-28 04:51:38 +00:00

diffusion

feat(magi2): add fused BF16 routed MoE path (#7206 )

2026-09-28 23:20:30 +08:00

distributed

[Bugfix] Fix MiniCPM-o 4.5 native duplex speech alignment (#7974 )

2026-09-24 10:04:28 +00:00

engine

[Core][Model] Fit PersonaPlex into the Unified Full-duplex Framework (RFC #7181 PR 2) (#7695 )

2026-09-27 03:02:24 +00:00

entrypoints

[TTS] Improve voice delete error message (#7795 )

2026-09-28 09:42:34 -04:00

experimental

[Bugfix][Core] Preserve static KV staging inputs in AR-Diffusion (#7921 )

2026-09-23 23:17:45 +08:00

host_weight_runtime

[Bugfix][Core] Clean up failed HWR atomic metadata writes (#6956 )

2026-09-11 09:03:26 +08:00

inputs

[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759 )

2026-09-15 20:43:30 -07:00

lora

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758 )

2026-01-27 10:22:40 +08:00

metrics

[Frontend][Benchmark] Add duplex performance metrics to refactored full-duplex framework (#7714 )

2026-09-22 03:04:22 -07:00

model_executor

feat(cosyvoice3): GPU-resident F0 predictor & pure-PyTorch vocoder (Task C2) (#7518 )

2026-09-28 23:13:43 +08:00

model_extras

[Bugfix] Align Ming-Image prompt templates and RNG, fix number of layer to decompose (#8118 )

2026-09-25 22:47:29 +08:00

outputs

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

platforms

[CI/Build] Cut L3 entrypoint BAGEL cold starts via L4 small-model sleep suites (#6851 ) (#7359 )

2026-09-23 22:06:58 -07:00

plugins

[Quantization] Migrate GGUF diffusion model support to OOT plugin (#4769 )

2026-07-11 18:48:43 +00:00

profiler

[Enhancement]modify profiling.md (#3051 )

2026-04-24 16:30:24 +08:00

protocol

[Frontend][Benchmark] Add duplex performance metrics to refactored full-duplex framework (#7714 )

2026-09-22 03:04:22 -07:00

quantization

[bugfix] Fix FP8 Quack kernels when using Context Parallelism and reduce number of recompilations (#7458 )

2026-09-22 11:38:17 -07:00

reasoning

[Rebase] Rebase to vLLM 0.29.0 (#7230 )

2026-09-10 12:08:28 +08:00

sample

update dirs

2025-09-11 15:43:43 +08:00

tokenizers

[Fix] Restore MammothModa2 support (#6694 )

2026-08-28 08:32:32 +08:00

transformers_utils

[Model] Support SenseNova-U1-A3B-MoT (MoE) (#8172 )

2026-09-27 08:48:08 +00:00

utils

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163 )

2026-09-26 22:51:04 +08:00

worker

[Performance][MiniCPM-o] Zero-copy block-aligned KV sliding window with in-place Re-RoPE for duplex Stage-0 (#7821 )

2026-09-28 10:11:54 +08:00

worker_v2

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163 )

2026-09-26 22:51:04 +08:00

__init__.py

feat: configure Torch Dynamo recompile limit from environment (#7243 )

2026-09-26 22:54:47 +08:00

data_entry_keys.py

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163 )

2026-09-26 22:51:04 +08:00

env_override.py

feat: configure Torch Dynamo recompile limit from environment (#7243 )

2026-09-26 22:54:47 +08:00

errors.py

[refactor] Refactor guardrail error handling - add 400 error code (#4297 )

2026-06-11 21:09:24 +00:00

logger.py

[BugFix] Failed to print DEBUG level log (#307 )

2025-12-15 07:13:36 +00:00

patch.py

[Rebase] Rebase to vLLM 0.30.0 (#7820 )

2026-09-22 15:52:01 +00:00

request.py

[Rebase] Rebase to vllm 0.28.0 (#6606 )

2026-08-27 06:12:55 +00:00

version.py

[Misc] Warn When vLLM / vLLM-Omni Have Mismatched Versions (#2691 )

2026-04-17 20:15:16 +08:00