Regarding undrstanding the num_workers in dataloader

I read the discussion regardiong the num_workers.
but im still confuse…
is larger num_workers better (as long as you dont get a memory error)?
is larger num_workers can lead to better results or worse results? does it even make any differences?

No, really large number of workers increase communication overhead, and can even slow down data loading.

it doesn’t affect results

2 Likes