How to Implement the last two optimization algorithms? I came to know about these optim algorithms from the following Tensorflow dev summit video https://www.youtube.com/watch?v=Zhdmjq0-Hng
There are a few implementation of the first one available: https://github.com/daviddao/pytorch-neural-search-optimizer or https://github.com/HaraldKorneliussen/pytorch-neural-search-optimizer
However, I have not found (yet?) an implementation for the second one (drop).
1 Like
Thanks a lot Jerome. I will try this optimization algorithm for now.