Hard disk space and data loader speed

1

Hi all,
My 10TB hard disk has only 1TB free space now. The data loader (which was working fine before) is super slow now (around 20x slow). Will the hard disk space causes this issue?.

Thanks

2

Hi,

This is most likely the hard drive that can do some optimization for speed when it’s not too full, but cannot when it has more content. So not pytorch related.
Have you tried freeing more space on the disk to see if performance come back?

1 Like
3

I will try freeing up some space and let you know the details. Thank you.

1 Like
4

Problem solved upon making some free space. Thanks