I just use the default setting of batch size 256 and 8 TiTAN XP gpus on resnet34， it takes about 1.5 hours for one epoch, I want to speed up the training process, Can I increase the batch size ?
I just use the default setting of batch size 256 and 8 TiTAN XP gpus on resnet34， it takes about 1.5 hours for one epoch, I want to speed up the training process, Can I increase the batch size ?