Machine Learning, Gradient Boosting, Data Science, Towards Data Science, Loss Function.
gradient boosting, as we show below. Training loss The training loss is optimized during training. It is hard to customize for certain algorithms, like the random forest (see here), but relatively easy for others, like gradient boosting and neural nets. Because some variant of gradient descent is