tzhouam 62c8695dfd Update GPUGenerationModelRunner to clarify KV connector metadata handling during draft model runs ...

- Changed variable name to better reflect its purpose in managing KV connector metadata.
- Updated comments for improved clarity regarding the handling of speculative configurations.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-03-13 03:16:33 +00:00

..

assets

Dev/rebase 0.14.0 (#847)

2026-01-21 00:25:25 +08:00

benchmarks

Dev/rebase v0170 (#1639)

2026-03-09 17:29:38 +08:00

config

Dev/rebase v0170 (#1639)

2026-03-09 17:29:38 +08:00

core

rebase: align vllm-omni with vLLM 84e436ed1c94

2026-03-11 07:29:52 +00:00

diffusion

[Bugfix]: SP attention not enabling when _sp_plan hooks are not applied (#1704)

2026-03-11 10:49:42 +08:00

distributed

[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load (#1714)

2026-03-10 21:02:33 +00:00

engine

rebase: align vllm-omni with vLLM 84e436ed1c94

2026-03-11 07:29:52 +00:00

entrypoints

Fix output queue handling in OmniStage to return None if queue is closed during shutdown

2026-03-13 01:59:04 +00:00

inputs

Dev/rebase v0170 (#1639)

2026-03-09 17:29:38 +08:00

lora

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)

2026-01-27 10:22:40 +08:00

metrics

Revert "[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)" (#1724)

2026-03-08 00:11:47 +13:00

model_executor

Refactor OpenAI serving components and enhance multimodal handling

2026-03-13 01:55:17 +00:00

platforms

[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load (#1714)

2026-03-10 21:02:33 +00:00

plugins

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

sample

update dirs

2025-09-11 15:43:43 +08:00

tokenizers

add support for MammothModa2 model (#336)

2026-03-04 22:52:56 +08:00

transformers_utils

add support for MammothModa2 model (#336)

2026-03-04 22:52:56 +08:00

utils

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

worker

Update GPUGenerationModelRunner to clarify KV connector metadata handling during draft model runs

2026-03-13 03:16:33 +00:00

__init__.py

add support for MammothModa2 model (#336)

2026-03-04 22:52:56 +08:00

logger.py

[BugFix] Failed to print DEBUG level log (#307)

2025-12-15 07:13:36 +00:00

outputs.py

[RL] Support collective rpc api to entrypoint && Support custom input output (#1646)

2026-03-09 10:12:43 +08:00

patch.py

[Bagel]: Support multistage img2img (#1669)

2026-03-09 22:23:50 +08:00

request.py

Dev/rebase v0170 (#1639)

2026-03-09 17:29:38 +08:00

version.py

[Version] Auto generate version using setuptool_scm (#1224)

2026-02-27 14:34:27 +08:00