Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
gradients into account during optimization. The team introduces a new angular coefficient to dynamically adjust the learning rate, enabling AngularGrad to control parameter adjustments and reducing the high variance of the gradients as it minimizes the direction cosines of two consecutive gradients