Data parallel tutorial

Hi there,

am just starting with pytorch, but have you tried using the flag: torch.backends.cudnn.benchmark=True. It should help (if you have a static architecture).

1 Like