Machine Learning, Gradient Boosting, Data Science, Towards Data Science, Loss Function.
iteration makes a new tree using training errors as target variables, but the boosting stops only when loss on validation data start increasing. The validation loss usually starts increasing when the model starts overfitting, which is the signal to stop building more trees. In this case, since