Machine Learning, Gradient Boosting, Data Science, Towards Data Science, Loss Function.
gradient descent. In the context of gradient boosting, the training loss is the function that is optimized using gradient descent, e.g., the “gradient” part of gradient boosting models. Specifically, the gradient of the training loss is used to change the target variables for each successive tree.