If you are using the iter/next
approach, the DataLoader
iterator might already start preloading the data once you call the next
op on it, so you could potentially overlap the loading of the first batches with other operations in your main script.
Such an approach can be seen here.