How to have a fluent dataloader?

You could use the new persistent_workers argument in the DataLoader construction, which will not shutdown the workers between epochs.