Distributed Training with Slurm

2

@heilaw did you have any success with this?

Found a link here from someone who claimed to get this working on slurm: https://www.glue.umd.edu/hpcc/help/software/pytorch.html#distrib