Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
smooths trajectory fluctuations and traces a more direct path towards the optimal solution of the cost function. The proposed AngularGrad also reduces the required computational resources, leading to improved training efficiency and performance. AngularGrad takes the angle between two consecutive