DataLoader, when num_worker >0, there is bug

Thanks for the debugging and pointing out strange issues.
I can reproduce the issues following your information.
It seems that multiprocessing doesn’t work well with HDF5/h5py.
Here is a similar issue with a link to the known problem.

Using the spawn method doesn’t solve the issue in this case. I’ll dig a bit deeper.

3 Likes