Shampoo instead of SGD for transfer learning tutorial

I guess that you use it as any other Optimizer from pytorch.
I don’t think there is any plan to incorporate it in the main repo.

1 Like