MIG compatibility with PyTorch

1

Hello,

Are there any known issues with memory allocation for PyTorch on Nvidia’s MIG instances (GPU is A100 80GB and the variant is 2g.20gb)? We’re seeing some crashes that worked fine on non-MIG enabled cards (like, T4).

We’re on PyTorch 1.11.0.

Thanks,
Bergen

2

There are no known issues. What kind of crashes are you seeing?