As long as you are loading the data into the system RAM (not the GPU memory), the number of workers shouldn’t yield a CUDA OOM issue.
Is this error reproducible with num_workers=25 or are you seeing this issue som3times even with 25 workers?
As long as you are loading the data into the system RAM (not the GPU memory), the number of workers shouldn’t yield a CUDA OOM issue.
Is this error reproducible with num_workers=25 or are you seeing this issue som3times even with 25 workers?