Lowest version of PyTorch supporting CUDA 11.8?

[akshu2023]

Seems to be a known issue. Unsure who is addressing this between nvidia and amd.

DDP training on RTX 4090 (ADA, cu118)

Seems to be AMD specific issue with multiple 4090s NCCL P2P functionality. Unsure who will resolve it when.