The first iteration can be slower, since the first batch would have to be loaded. However, the following iterations should be faster, if the actual model workload is not tiny.
If you want to avoid this slowdown in each epoch, you could use this workaround.
1 Like