Pytorch will cache communicator for different ranks, for P2P the communicator is named “{src_rank}:{dst_rank}” ref, how can I create different communicator for send/recv for same ranks?
Pytorch will cache communicator for different ranks, for P2P the communicator is named “{src_rank}:{dst_rank}” ref, how can I create different communicator for send/recv for same ranks?