Optimization Algorithms, Mathematics, Machine Learning, Statistics, Convex Optimization.
are no effective methods to solve these problems. Even a simple problem with few variables can be extremely hard to solve. Local optimization We give up looking for the optimal x. Instead, we seek a point that is only locally optimal (a good enough point). This only requires the differentiability