Currently the torch.distributed
package only has all_to_all_single
and all_to_all
that support tensor communications rather than for general (picklable) objects. Are we planning to add the general object support, just as the cases for scatter and gather? It can be useful.