_error_if_any_worker_fails() error for dataloader

1

HI,

When use dataloader for my custom implemented dataset, I met _error_if_any_worker_fails() error. What is the reason to cause this error? Is there good python debug tool to debug this issue? Thanks

2

Hi,

This means that one of the process used to load data crashed.
If you run the dataloader with 0 process (so no worker), it should raise the error directly in the main process.

3

When I set worker=0, there is no crash

4

there is an error message printed togther and you should look at that

5

It seems the error messages are different from test to test.