Data Loader First Batch from each epoch is slow

2

The DataLoader iterator is recreated in each epoch and with it all workers, which will all start the prefetching from the beginning.
Here is a potential workaround for this behavior.