DataParallel and DataLoader stuck

Hello. I am using nn.DataParallel to enable multi-GPUs to train my model. However, I met problems with DataLoader. The Loader always stucks after a few iterations. When I switch back to single GPU, everything goes smooth. What can be wrong?