Slow data loading when training a classification model on ImageNet

This post might give you some information about data loading bottlenecks.