Official torch.distributed web doc.
Are there any special reasons to not call dist.destory_process_group ?
I don’t think there is a specific reason for it and it might just have been forgotten. Would you be interested in contributing the missing docs?
Got it. Thanks for the reply! I’d like to leave it to the official pytorch team.