CUDNN version: https://github.com/pytorch/pytorch/issues/698#issuecomment-326806780
torch.backends.cudnn.version()
CUDA version: Pytorch 0.4 get cuda version
torch.version.cuda
NCCL version: How to check if NCCL is installed correctly and can be used by PyTorch?
torch.cuda.nccl.version()