Is Data Parallel(or DDP) equivalent to larger batch

[PistonY (Devin Yang)]

DataParallel vs DistributedDataParallel

Hi, what is the difference between model = nn.parallel.DistributedDataParallel(model, device_ids=[args.gpu]) and model = nn.DataParallel(model, device_ids=[args.gpu]) ?

I think this should be helpful.