Pytorch >= 1.7.0 support for A100 GPUs?

1

I read in the blog when pytorch 1.7 was released that now pytorch supports A100 GPUs. However the pre-built binaries apparently do not support sm_80 arch and pytorch has to be built from source to support that. Is this accurate? Is there a comprehensive guide on how to build from source and enable sm_80 arch support? Or even better, is there a proper pytorch docker image that supports sm_80?

2 Likes
2

No, that’s not true and the binaries are shipping with sm_80 since the 1.7.0 release.

3

Hi @ptrblck - I just updated my pytorch to version 1.8.1 and I am getting an error which basically says that on my A100 GPU sm_80 is not supported. I opened a separate thread here about this: NVIDIA A100 GPU - RuntimeError: cuDNN error: CUDNN_STATUS_MAPPING_ERROR

4

Right - I think I have fixed this now. I’ll post the solution in the other thread.