I use the dist.new_group build a new group, but how to check it is right? The document shows that new_group should include all worker, but I don’t want to include the first worker.
group = dist.new_group([i for i in range(1, dist.get_world_size())])
dist.all_reduce(param.grad.data, op=dist.reduce_op.SUM, group=group)