- Added installation of vLLM from a precompiled wheel with a specific commit. - Set LD_LIBRARY_PATH for CUDA compatibility with bitsandbytes. - Upgraded flashinfer dependencies and ensured proper installation order for torch to avoid symbol issues.
- Added installation of vLLM from a precompiled wheel with a specific commit. - Set LD_LIBRARY_PATH for CUDA compatibility with bitsandbytes. - Upgraded flashinfer dependencies and ensured proper installation order for torch to avoid symbol issues.