Torch.distributed.barrier() hangs in DDP

Issue created!

I’m sorry it took me a day extra :sweat_smile: