Is there an easy way to send arbitrary data type with the distributed mode? It looks like the current API only supports sending tensors.
In principle, I can serialize the data myself and stuff it into a
ByteTensor, but that seems to incur a lot of overhead.
mpi4py can send arbitrary
dict by invoking
pickle under the hood. It’d be great if pytorch can support sending arbitrary data by
protobuf as well. Or someone can let me know what’s the correct way to implement it. I might submit a pull request.