59db6a4285
Signed-off-by: tzhouam <tzhouam@connect.ust.hk> Signed-off-by: Gao Han <hgaoaf@connect.ust.hk> Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com> Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
14 lines
477 B
Markdown
14 lines
477 B
Markdown
# Installation
|
|
|
|
!!! important
|
|
vLLM-Omni is released against the matching upstream vLLM major/minor version. The 0.30 development line requires vLLM 0.30.x; the source-install instructions pin vLLM 0.30.0. Published vLLM-Omni 0.28.0 wheels and images still require vLLM 0.28.x.
|
|
|
|
vLLM-Omni supports the following hardware platforms:
|
|
|
|
- [GPU](gpu.md)
|
|
- [NVIDIA CUDA](gpu.md)
|
|
- [AMD ROCm](gpu.md)
|
|
- [Intel XPU](gpu.md)
|
|
- [MThreads MUSA](gpu.md)
|
|
- [NPU](npu.md)
|