Optimization Algorithms, Optimization Techniques, Machine Learning, Deep Learning, Convex Optimization.
to find upon minimizing L. The optimal values are represented by (*) in the figure below. The Loss function has a minimum with respect to all the model coefficients at the optimal values (*) [Image by author] Without going into the derivations in this article (planned in a follow-up article), the