I know that Pytorch only supports upto cuda 10.0. So if I only have CUDA 10.1, will Pytorch not run? Or, since CUDA 10.1 is backward compatible, would Pytorch run as if 10.0 were installed?
If you install PyTorch using conda or pip, the binaries will ship their own CUDA and cuDNN. Your system CUDA installation will be used if you build from source.