Question about Dataloader and GPU memory usage

  1. Batch size indicates the size of data that comes out of dataloader at a time. i.e., in your case, you will have count=8 data assigned to the GPU. num_workers defines the number of threads spawned to read the data.

  2. Take a look at this: When to set pin_memory to true?