Based on the topic here DDP training on RTX 4090 (ADA, cu118) - #25 by thefreeman it seems we can not taking advantage of using two 4090 cards in PyTorch?
Yes they have fixed the error but the problem is still there " Device 1 is not peer capable with some other selected peers, skipping"