Distributed data parallel freezes without error message

[Feywell]

@iamshnik @ptrblck
This is my problem in detail
Is it the same problem?

Distributed training failed without errors

I just change https://github.com/ZPdesu/SEAN to distributed training. And I get a weird error. It is no error，when I use one gpu. But, It will stop without printing errors when I use multi gpus. It will stop after Every 13 epoches by two gpus. What could be the cause of such a problem？ my environments: ubuntu: 16.04 gpu：nvidia-2080ti cuda: 10.1 / 10.2 pytorch: 1.6.0 / 1.7.0 nccl: 2.4.8 / 2.7.6 python:3.6 / 3.7