Multi workers specified by num_workers load samples to form a batch, or each worker load a batch respectively in DataLoader?

[alex.veuthey]

Apparently, it would be case #2. See this answer.