Machine Learning, Gradient Boosting, Data Science, Towards Data Science, Loss Function.
we think is the most clear: Training loss. This is the function that is optimized on the training data. For example, in a neural network binary classifier, this is usually the binary cross entropy. For the random forest classifier, this is the Gini impurity. The training loss is often called the