Guidelines for assigning num_workers to DataLoader

if the data set is small like cifar10, why doesn’t the whole data set stay in the GPU the whole time? Why would # workers do anything?