Optimization, Deep Learning, Convex Optimization, Optimal Performance, Approximation.
including convergence to a stationary point, convergence to a local minimum, local convergence to the global minimum, and global convergence to the global minimum. As an example, let us consider the widely used SGD. Non-convex SGD converges with a slow theoretical rate, but not necessarily to a