Yes, the CUDA runtime used by your PyTorch binaries will be shown via print(torch.version.cuda) and would be 10.2 in your use case, which is why the error is raised as your Ampere GPU needs CUDA>=11.
Thanks again for your answer!! I am a new starter and your answers towards many questions have helped me a great deal! 