Optimization Algorithms, Optimization Techniques, Machine Learning, Deep Learning, Convex Optimization.
algorithm, or the Newton GLTR trust-region algorithm. Do I need to know all of this? Well, some of these techniques are actually used in ML algorithms!. For example, the LogisticRegression class of the scikit-learn library uses the BFGS algorithm by default. Similarly, for Constrained optimization