How can I use multiple MIG instances with PyTorch?

You cannot use multiple MIG slices in a distributed setup as described also here.

1 Like