according to the website it should be.
but for some reason it won’t use my gpu the only answers I found here were to downgrade my Cuda version…
I don’t know which answers you are referring to but your locally installed CUDA toolkit won’t be used. PyTorch is compatible with CUDA 12.4 and the install matrix shows the command to install these binaries with the corresponding CUDA dependencies.