Machine Learning, Data Science, Supervised Learning, Editors Pick, Getting Started.
Each new weak learner added minimizes the ensemble’s loss function. (Image by author) And because the optimization algorithm used to find the next weak learner is Gradient Descent, the loss function must differentiable and convex. However, this time Gradient Descent is used in a function space.