Machine Learning, Deep Learning, Neural Networks, Optimization Algorithms, Adam.
descent converges slowly, let us look at the example below of a ravine where a given function of two variables should be minimised. Example of an optimization problem with gradient descent in a ravine area. The starting point is depicted in blue and the local minimum is shown in black. A ravine is