Optimization, Deep Learning, Convex Optimization, Optimal Performance, Approximation.
practically motivated algorithms for non-convex optimization with rigorous guarantees. Non-convex Optimization Convergence For NCO, many CO techniques can be used such as stochastic gradient descent (SGD), mini-batching, stochastic variance-reduced gradient (SVRG), and momentum. There are also