vllm-omni

0 Fork 0

Files

T

tzhouam 2c2d06d920 [Enhancement] Update GPUARWorker and GPUGenerationWorker to enforce v1 model runner

- Added a warning in GPUARWorker and GPUGenerationWorker to indicate that the v2 model runner does not include omni hooks, forcing the use of the v1 model runner.
- Updated import statements in gpu_ar_model_runner.py and gpu_generation_model_runner.py to include necessary functions from parallel_state.
- Removed unused imports from both model runner files to streamline the code.

Signed-off-by: [Your Name] <your.email@example.com>

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-01-28 15:43:27 +08:00

npu

[NPU] Upgrade to v0.14.0 (#820 )

2026-01-27 16:45:32 +08:00

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

gpu_ar_model_runner.py

[Enhancement] Update GPUARWorker and GPUGenerationWorker to enforce v1 model runner

2026-01-28 15:43:27 +08:00

gpu_ar_worker.py

[Enhancement] Update GPUARWorker and GPUGenerationWorker to enforce v1 model runner