Signed-off-by: tzhouam <tzhouam@connect.ust.hk> Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk> Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
14 lines
477 B
Markdown
14 lines
477 B
Markdown
# Installation
|
|
|
|
!!! important
|
|
vLLM-Omni is released against the matching upstream vLLM major/minor version. The 0.29 development line requires vLLM 0.29.x; the source-install instructions pin vLLM 0.29.0. Published vLLM-Omni 0.28.0 wheels and images still require vLLM 0.28.x.
|
|
|
|
vLLM-Omni supports the following hardware platforms:
|
|
|
|
- [GPU](gpu.md)
|
|
- [NVIDIA CUDA](gpu.md)
|
|
- [AMD ROCm](gpu.md)
|
|
- [Intel XPU](gpu.md)
|
|
- [MThreads MUSA](gpu.md)
|
|
- [NPU](npu.md)
|