Which pytorch version >2.0.1 support cuda 11.4

1

I’m trying to finetune Mistral 7B, and I get this runtime error of unsupported Cuda drivers.
RuntimeError: The NVIDIA driver on your system is too old (found version 11040). Please update your GPU driver by downloading and installing a new version from the URL: Official Drivers | NVIDIA Alternatively, go to: https://pytorch.org to install a PyTorch version that has been compiled with your version of the CUDA driver.
Using torch 2.0.0 doesn’t support FSDP and requires >=2.0.1
torch.cuda.is_available() == False

2

I assume you installed a recent PyTorch binary shipping with CUDA 12.1 while your system uses an older driver which shipped with CUDA 11.4. If you don’t want to update the NVIDIA driver you could install the latest PyTorch release with CUDA 11.8 instead.

1 Like
3

It works, I installed Pytorch==2.0.1