Gradient Descent, Deep Learning, Machine Learning, Optimization Techniques, Artificial Intelligence.
optimizer thus plays a crucial role in the efficiency of the training process and the final generalization performance of a DNN. The IEEE researchers say theirs is the first study to utilize a gradient vector’s direction and angle information as well as its magnitude. This approach significantly