Torch.dist.distributedparallel vs horovod

[bkuriach]

@ptrblck Thank you very much for your response!!