Use both gradient and Hessain to update the weights in FNN


(Parth Gupta) #1

Hello,

I have studied 2nd order optimization methods like BFGS and Newton’s method, but can anyone help me understand how do we backpropagate the Hessian matrix in let say a feed-forward neural network? Thanks !!