CUDA driver, CUDA toolkit and Pytorch

PyTorch Live
1

I have installed:

  • NVIDIA-SMI 551.61,
  • Driver Version: 551.61,
  • CUDA Version: 12.4,
    and I’m about to install CUDA toolkit to enable pytorch locally.
    I see that the latest pytorch version is compatible with CUDA toolkit 12.1.
    Should I install CUDA toolkit 12.4 or 12.1?
    I am running windows 11 with GPU = NVIDIA RTX 2000 Ada
    Thanks in advance!
2

The PyTorch binaries ship with their own CUDA dependencies and your locally installed CUDA toolkit will be used if you build from source or custom CUDA extensions.

1 Like