Will horovod be compatible with pytorch 2.0

If we have horovod running with pytorch 1.x, will it be possible to upgrade to pytorch 2.0 and run the code as usual. And would it be compatible with a compiled graph?

There are no backward compatibility breaking changes in PyTorch 2.0 when it comes to running distributed jobs.

Whether you’ll be able to use torch.compile or not depends on the model itself.

1 Like

Thanks for clarifying