Apparent side effects of DataLoader on model training

You might be running into this issue.