Low GPU Usage during Training

Low GPU utilization problem - PyTorch Forums

As you see the link you need to increase the num_workers. As that might be one of the cause