Dataloaders and performance

If you use the CIFAR10 dataset from torchvision, the data will be loaded into the memory as you suggested (line of code).

I’m not sure, which disc you are using, but have a look at this post for some information on potential bottlenecks.