I want to use vllm 0.9.0 since its new feature support running fp8 like models in A100. But vllm 0.9.0 strongly related to pytorch 2.7.0. I cannot install pytorch 2.7.0 at Centos7 since my linux machine’s glibc is 2.17, and pytorch 2.7.0 requires glibc 2.28.
CentOS7 reached its EOL on June 30 2024 and we thus bumped the min. GLIBC to 2.28. I would recommend updating your OS to receive security updates etc. Alternatively, you could try to install an older PyTorch binary but it might not be compatible with the desired vllm binary.