nn.DataParallel gets stuck

Hello @ptrblck , sorry for my late answer.

It seems to be the same issue as with nn.DataParallel The process gets stuck and the volatile GPU usage seems to be 100%, attached the screenshot of nvidia-smi