Use both gradient and Hessain to update the weights in FNN

Hello,

I have studied 2nd order optimization methods like BFGS and Newton’s method, but can anyone help me understand how do we backpropagate the Hessian matrix in let say a feed-forward neural network? Thanks !!

1 Like