optimization equation Newton Method, Gradient descent, momentum. How do we use for proper? Newton Method is an optimization equation to find minimum point better than Gradient descent. Now we use momentum with gradient for smoothly. Why don't we use the Newton method?

Newton's method involves the calculation of the inverse of Hessian matrix, which is far too expensive to calculate in many cases in deep learning. That is why other approximation methods are preferred.
