Seems to be AMD specific issue with multiple 4090s NCCL P2P functionality. Unsure who will resolve it when.