The new Graviton servers are so much cheaper to run but building from source has proven to be incredibly painful. I’ve managed to get things mostly working but I still cannot get torchvision to build with image support no matter what I’ve tried.
Yes, we are working on binaries but in the meantime you can use PyTorch NGC containers supporting ARM for some time already.
Yeah, I had discovered that a couple days ago. I was fighting with getting the containers to recognize CUDA even with the Nvidia container stuff installed. I probably just need to clean slate a server and try that from scratch at this point since I’ve done installing and uninstalling for weeks on this server trying to brute force getting torch and torchvision working with CUDA. I finally got torch working but torchvision has refused to work with image support and I’ve about thrown in the towel on it because the error messages are absolutely no help even with looking at the code. Everything according to the build logs says it worked, it just doesn’t.