I don’t see pytorch/pytorch:2.4.1-cuda12.4-cudnn8-devel image in docker hub. I’m trying to run my pytorch lightning setup on 4 RTX 4090s.I was told RTX 4090 only supports 8.9 compute capability…is this different from cuDNN9 and cuDNN8? Can I use pytorch/pytorch:2.4.1-cuda12.4-cudnn9-devel with RTX 4090?
That’s wrong since compute capability 8.9 is binary compatible with 8.6 and 8.0.
Yes, the compute capability of a GPU is not directly related to cuDNN versions (the library itself needs to build their kernels for a compatible GPU architecture but cuDNN8 does not correspond to compute capability 8.x).