amy-why-3459 5dd1d0a772 [BugFix] Fix prefix-caching issue (#3726) ...

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>

2026-05-29 01:51:54 +00:00

..

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

base.py

[bugfix, rl] Fix sleep do not release full memory in custom pipeline (#3818)

2026-05-28 22:27:27 +08:00

gpu_ar_model_runner.py

[BugFix] Fix prefix-caching issue (#3726)

2026-05-29 01:51:54 +00:00

gpu_ar_worker.py

[MUSA][Feat] torch.accelerator support (#3101)

2026-04-24 15:31:45 +00:00

gpu_generation_model_runner.py

[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode (#3719)

2026-05-28 14:06:41 +08:00

gpu_generation_worker.py

[MUSA][Feat] torch.accelerator support (#3101)

2026-04-24 15:31:45 +00:00

gpu_memory_utils.py

Process-Scoped GPU Memory Accounting (#1204)

2026-02-08 22:43:02 +08:00

gpu_model_runner.py

[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode (#3719)

2026-05-28 14:06:41 +08:00

mixins.py

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

omni_connector_model_runner_mixin.py

[Diffusion] Unify diffusion request identity on request_id (#3744)

2026-05-28 14:56:56 +08:00

payload_span.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00