Hi, lets assume that
num-workers = 8 and
So, 2*8 = 16 number of batches have to be pre loaded .
Now, when the current batch is consumed by a worker and
next is called on the data loader, how many new batches does it fetch? As I understand, 1 new batch is fetched for every consumed batch to maintain the constant count of 16 batches each time. Is this correct ?
Do the number of batches always remain 16 and for every batch consumed, a new batch would be fetched ?