Hi Pytorch team,
I’m using pytorch to traing a model, I see during the training, 3 new dataloader processes have been created, I would like to under what conditions these processes will be created?
the number of workers is 8, so there should be 8 dataloader processes,
root 95860 71732 78 Sep29 ? 18:34:04 name
root 95919 71732 78 Sep29 ? 18:25:29 name
root 95980 71732 73 Sep29 ? 17:14:03 name
root 95983 71732 76 Sep29 ? 18:02:14 name
root 96029 71732 78 Sep29 ? 18:33:04 name
root 96069 71732 78 Sep29 ? 18:31:12 name
root 96102 71732 77 Sep29 ? 18:12:11name
root 96112 71732 78 Sep29 ? 18:34:11 name
root 99822 71732 1 Sep29 ? 00:09:25 name
root 99831 71732 1 Sep29 ? 00:10:11 name
root 99848 71732 1 Sep29 ? 00:09:39 name
As shown above, there are 3 new processes have been created 10 minutes before.