Compatibility between CUDA 12.6 and PyTorch

1

Hello,

I’m in the process of fine tuning a LLM, and my machine has these specifications:

NVIDIA RTX A6000
NVIDIA-SMI 560.35.03
CUDA Version: 12.6

I have hard time to find the right PyTorch packages that are compatible with my CUDA version.

Does anyone know which one should I download it?
Every suggestion is welcome.

Thank you

2

Your locally installed CUDA toolkit won’t be used unless you build PyTorch from source or a custom CUDA extension, since the PyTorch binaries ship with their own CUDA runtime dependencies. You can thus select any PyTorch binary with CUDA 12.x and I would recommend using the latest one (12.4.1).

1 Like