Alex Brooks f1e3f03726 [feature] Hidden State Prefix Caching (#2164) ...

Signed-off-by: Alex Brooks <albrooks@redhat.com>

2026-04-15 17:01:45 +00:00

..

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

base.py

[Refactor] Unify torch profiler for omni and diffusion models (#2099)

2026-03-24 15:25:52 +08:00

gpu_ar_model_runner.py

[feature] Hidden State Prefix Caching (#2164)

2026-04-15 17:01:45 +00:00

gpu_ar_worker.py

[Rebase] Rebase to vllm v0.18.0 (#2037)

2026-03-21 20:37:38 +08:00

gpu_generation_model_runner.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00

gpu_generation_worker.py

[Rebase] Rebase to vllm v0.18.0 (#2037)

2026-03-21 20:37:38 +08:00

gpu_memory_utils.py

Process-Scoped GPU Memory Accounting (#1204)

2026-02-08 22:43:02 +08:00

gpu_model_runner.py

[feature] Hidden State Prefix Caching (#2164)

2026-04-15 17:01:45 +00:00

mixins.py

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

omni_connector_model_runner_mixin.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00

payload_span.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00