Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
in each step. The team proposes two versions of the optimizer based on the cosine and tangent angles on the value of the angular coefficient, denoted as AngularGrad^cos and AngularGrad^tan respectively. To evaluate their proposed optimizer, the team modelled optimization as a regression problem