data.Dataset inheritance to write my own dataset read class

6

h5py (and underlying HDF5 library) does not work with Python multiprocessing. It is a known issue.

This thread has some discussion and possible workarounds: HDF5 Multi Threaded Alternative

1 Like