vllm-omni/docs/getting_started/installation/npu.md

NPU

vLLM-Omni supports NPU through the vLLM Ascend Plugin (vllm-ascend). This is a community maintained hardware plugin for running vLLM on NPU.

Requirements

• OS: Linux
• Python: 3.12

!!! note vLLM-Omni is currently not natively supported on Windows.

=== "NPU"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:requirements"

Installation

Recommended

=== "NPU"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:installation"