CUDA driver, CUDA toolkit and Pytorch

I have installed:

  • NVIDIA-SMI 551.61,
  • Driver Version: 551.61,
  • CUDA Version: 12.4,
    and I’m about to install CUDA toolkit to enable pytorch locally.
    I see that the latest pytorch version is compatible with CUDA toolkit 12.1.
    Should I install CUDA toolkit 12.4 or 12.1?
    I am running windows 11 with GPU = NVIDIA RTX 2000 Ada
    Thanks in advance!

The PyTorch binaries ship with their own CUDA dependencies and your locally installed CUDA toolkit will be used if you build from source or custom CUDA extensions.

1 Like