Hi, Is there any example to use torch data and DDP for multi node gpu training, I wanted to learn how to, shard and shuffle data. I also saw we can’t use Distributed Data Sampler, so what’s the best way to create samples.
1 Like