The synchronization of gradients happens during the backwards for DDP

autograd
1

Hi, I know the synchronization of gradients happens during the backwards for DDP. But I didn’t find the corresponding script in backwards. Where can I find it?