Guidelines for assigning num_workers to DataLoader

It might solve your issue and it definitely worth a try.
However, if I’m correct in the assumption that you are using a network drive, I would still recommend to copy the data into a local SSD (if possible of course).