Shampoo instead of SGD for transfer learning tutorial

1

Today I learned about Shampoo. I want to know if I will have gain over SGD for transfer learning tutorial if I have a total of 1500 images?

Also, I am not sure how to use something like this repo in the PyTorch code?

Will it be incorporated into the native PyTorch?

2

I guess that you use it as any other Optimizer from pytorch.
I don’t think there is any plan to incorporate it in the main repo.

1 Like