TaffyOfficialandTaffyOfficial ee33601571 [Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734) ...

Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>

2026-06-01 09:35:07 +00:00

..

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

base.py

[bugfix, rl] Fix sleep do not release full memory in custom pipeline (#3818)

2026-05-28 22:27:27 +08:00

gpu_ar_model_runner.py

[Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734)

2026-06-01 09:35:07 +00:00

gpu_ar_worker.py

[MUSA][Feat] torch.accelerator support (#3101)

2026-04-24 15:31:45 +00:00

gpu_generation_model_runner.py

[Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734)

2026-06-01 09:35:07 +00:00

gpu_generation_worker.py

[MUSA][Feat] torch.accelerator support (#3101)

2026-04-24 15:31:45 +00:00

gpu_memory_utils.py

Process-Scoped GPU Memory Accounting (#1204)

2026-02-08 22:43:02 +08:00

gpu_model_runner.py

[Rebase] Rebase to vllm releases/v0.22.0 (#3891)

2026-06-01 11:08:12 +08:00

mixins.py

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

omni_connector_model_runner_mixin.py

[Diffusion] Unify diffusion request identity on request_id (#3744)

2026-05-28 14:56:56 +08:00

payload_span.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00