Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
optimizer in model training, but such existing optimizers are unable to exploit any gradient angular information other than magnitude. To overcome these limitations, a team from the IEEE (Institute of Electrical and Electronics Engineers) has proposed AngularGrad — a novel optimization algorithm