Implementation of optimization algorithms

How to Implement the last two optimization algorithms? I came to know about these optim algorithms from the following Tensorflow dev summit video

There are a few implementation of the first one available: or
However, I have not found (yet?) an implementation for the second one (drop).

1 Like

Thanks a lot Jerome. I will try this optimization algorithm for now.