Hello! I wanted to ask if anyone knows of an implementation of the Natasha2 algorithm (introduced in this paper by Zeyuan Allen-Zhu: https://arxiv.org/abs/1708.08694)
Natasha2 uses the Oja’s algorithm to avoid saddle points and converge to a local minimum for non-convex functions.
1 Like