I understand that num_workers in dataloader is for multi-threaded independent batching. Then why is it recommended that this value should not be more than batch size for efficiency? What num_workers has to do with the batch size?
I understand that num_workers in dataloader is for multi-threaded independent batching. Then why is it recommended that this value should not be more than batch size for efficiency? What num_workers has to do with the batch size?