Abstract
Incorporating curvature information in stochastic methods has been a challenging task. This paper proposes a momentum accelerated BFGS quasi-Newton method in both its full and limited memory forms, for solving stochastic large scale non-convex optimization problems in neural networks (NN).
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have