Sy03 d530938b5b [Model] Reuse frame-local KV in MOSS-TTS Local ...

Cache each position once while generating the audio codebooks, preserving frame-local RoPE positions and the full-prefix reference path. Share compiled batch and position shapes to avoid specialization-limit fallback. Add one compact parity regression covering frame reuse.

Signed-off-by: Sy03 <1370724210@qq.com>

2026-09-08 06:37:00 +08:00

..

assets

[Feat] Add support and testcase for HunyuanImage-3.0-Instruct-Distil (#4048)

2026-09-03 02:43:13 +00:00

attention

[Rebase] Rebase to vllm 0.26.0 (#5443)

2026-07-27 23:35:49 +08:00

benchmarks

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)

2026-09-05 08:20:21 +00:00

buildkite

[CI] Select mirror_hardwares presets via MIRROR_HW (H100/B200) (#5543)

2026-09-02 15:39:49 +00:00

clients

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)

2026-09-05 08:20:21 +00:00

config

[Feature][LingBot World]stepwise execution (#6844)

2026-09-07 13:38:23 +08:00

core

[Model] Preserve MiniCPM-o Talker full attention until capacity (#6799)

2026-09-06 22:25:35 +08:00

dfx

[CI][Bugfix] Use the matching checkpoint for Qwen3-TTS VoiceDesign tests (#7054)

2026-09-06 04:27:21 +00:00

diffusion

[Bugfix][Diffusion] Make Cosmos3 transfer image arrays writable (#6915)

2026-09-07 01:06:16 -07:00

distributed

[Feature] Define the runner preprocess phase contract and regression coverage (#7136)

2026-09-06 17:20:04 +00:00

docs

[Bugfix] Stop reading the removed OmniRequestOutput.request_output accessor (#6172)

2026-08-15 07:07:28 +08:00

e2e

[Feature][LingBot World]stepwise execution (#6844)

2026-09-07 13:38:23 +08:00

engine

[Feature][LingBot World]stepwise execution (#6844)

2026-09-07 13:38:23 +08:00

entrypoints

[Test] Consolidate MOSS-TTS batching regression coverage

2026-09-08 03:03:32 +08:00

examples

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)

2026-09-05 08:20:21 +00:00

helpers

Parallel stage initialization (admission + SH/EX device locks) (Worker refactor 1/N) (#5224)

2026-09-05 22:22:41 +08:00

host_weight_runtime

[Bugfix] Make HWR filesystem lifecycle transitions fail-closed (#6692)

2026-08-28 09:30:17 +08:00

inputs

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

metrics

[Bugfix] Report engine-queued requests as waiting in vllm_omni:num_requests gauges (#6549)

2026-08-29 03:58:26 +00:00

model_executor

[Model] Reuse frame-local KV in MOSS-TTS Local

2026-09-08 06:37:00 +08:00

model_extras

[Model] Add native MAGI-2 Preview diffusion support (#5918)

2026-09-05 15:32:30 +08:00

model_tests

[Model] Add native MAGI-2 Preview diffusion support (#5918)

2026-09-05 15:32:30 +08:00

platforms

[Diffusion] Add paged KV cache support for HunyuanImage3 DiT on NPU and GPU (#6563)

2026-08-31 10:15:46 +00:00

profile

[Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951)

2026-07-29 23:53:03 +08:00

quantization

[Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951)

2026-07-29 23:53:03 +08:00

reasoning

[Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951)

2026-07-29 23:53:03 +08:00

tools

[Migrate] Move sampling parameter overrides from legacy dispatches to TTS adapters (#5272)

2026-08-16 21:14:26 -07:00

utils

[Core] Validate PipelineConfig in __post_init__ (#6829)

2026-09-01 11:17:57 +08:00

worker

[Test] Consolidate MOSS-TTS batching regression coverage

2026-09-08 03:03:32 +08:00

__init__.py

[Fix] Resolve comments & update vLLM-Omni name usages. (#122)

2025-12-01 08:05:24 +08:00

conftest.py

[CI]Split GPU jobs by cards_* and reject hand-written SKU marks (#6650)

2026-08-29 18:42:33 +08:00