rein yangandSy03 ad3a162eb8 [perf] Minicpm o4.5 optimization (#5228) ...

Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Co-authored-by: Sy03 <1370724210@qq.com>

2026-07-24 17:20:39 +08:00

..

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

base.py

[bugfix, rl] Fix sleep do not release full memory in custom pipeline (#3818)

2026-05-28 22:27:27 +08:00

gpu_ar_model_runner.py

[perf] Minicpm o4.5 optimization (#5228)

2026-07-24 17:20:39 +08:00

gpu_ar_worker.py

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

gpu_generation_model_runner.py

[perf] Minicpm o4.5 optimization (#5228)

2026-07-24 17:20:39 +08:00

gpu_generation_worker.py

[Refactor] Replace hardcoded CUDA device selection with platform-agnostic API (#4496)

2026-06-23 14:38:32 +08:00

gpu_memory_utils.py

Process-Scoped GPU Memory Accounting (#1204)

2026-02-08 22:43:02 +08:00

gpu_model_runner.py

[perf] Minicpm o4.5 optimization (#5228)

2026-07-24 17:20:39 +08:00

memory_utils.py

[Rebase] Rebase to vllm 0.23.0 (#4286)

2026-06-13 16:43:02 +00:00

mixins.py

[Hardware] Support platforms and plugin system (#774)

2026-01-28 22:12:52 +08:00

omni_connector_model_runner_mixin.py

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

payload_span.py

[core]refactor communication layer: PR1(Added Refactor Infra Only) (#1555)

2026-04-13 16:01:14 +08:00

runner_assisted_metadata.py

[Perf][VoxCPM2] Add unified decode graph optimization (#4606)

2026-07-04 05:30:48 +00:00

sampling_utils.py

[Bugfix] Drop out-of-vocabulary stop ids from min-tokens masking (qwen3-tts min_tokens engine crash) (#4971)

2026-07-08 11:24:31 -07:00