Machine Learning, Gradient Boosting, Data Science, Towards Data Science, Loss Function.
loss on the out of sample validation set. As shown in the figure below, setting stopping rounds higher leads to the model running for more boosting rounds. Blue: Training loss. Orange: Validation loss. Both training and validation are using the same custom loss function k-fold cross validation.