I have two computer, each one has one gpu, how do I use these two gpu combined to train one model? Also, how do I combine colab gpu with local machine gpu to train model?
Use DDP or Ray.