Pickle local object with DistributedDataParallel

Hi @rvarm1 thanks for your answer, again :slight_smile: An example would be using tensorboard, as I mentioned in another post: Using tensorboard with DistributedDataParallel