Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
that takes both gradient direction and angular information into consideration. The proposed method successfully reduces the zig-zag effect in the optimization trajectory and speeds up convergence. DNN training can be interpreted as obtaining a mathematical function that maps an input with a