All_reduce a list of tensors

distributed
2

Figure it out! I have to make the tensor contiguous before reducing it. This article provides a nice description of it.

1 Like