NVIDIA NVIDIA RTX A5000 with CUDA capability sm_86 is not compatible with the current PyTorch installation

Your Ampere GPU needs CUDA11+ while your current installation uses cudatoolkit=10.2 and will thus not work. The CUDA10.2 binaries are also not shipping sm_86 for the same reason.
Install the CUDA11.3 binary and it should work. If you are hitting conflicts, create a new conda environment and install it again.

1 Like