MCCL: First Native MPS distributed backend for Pytorch

Created a DDP backend for apple silicon devices, tested it working across a m1max + m4max MBP.

There’s a demo video in the repo showing it working: https://github.com/mps-ddp/mccl

I’m definitely looking for additional eyes from experts who really know what they’re doing

cheers!

2 Likes