Resizing the image is taking very long

[Navneet_Sajwan]

I have 3662 images in my trainset, batchsize is 128. When I am performing iter(dataloader).next() it takes about 20 seconds for this batch size. I narrowed down on the problem and found that resizing the image is taking up most of the time. I am using torchvision.transforsms.Resize() to resize the images.

[InnovArul (Arul)]

Have you tried increasing the num_workers parameter of data loader?

Guidelines for assigning num_workers to DataLoader

Having more workers will increase the memory usage and that’s the most serious overhead. I’d just experiment and launch approximately as many as are needed to saturate the training. It depends on the batch size, but I wouldn’t set it to the same number - each worker loads a single batch and returns it only once it’s ready. num_workers equal 0 means that it’s the main process that will do the data loading when needed, num_workers equal 1 is the same as any n, but you’ll only have a single worker…

[Navneet_Sajwan]

Yes, I did. It became slower.