I know that setting
num_workers > 0 in
Dataloader may speed training and data access. According to documentation
num_workers is about
how many subprocesses to use for data loading.
0means that the data will be loaded in the main process.
Does the loading refer to loading data into the RAM? For instance, suppose that there is enough memory to read the dataset; hence, our data is read from a text file when creating an instance of
Dataset class. Now if we use
num_workers > 0 when defining
Dataloader, do we gain any advantage of these workers?