Machine Learning, Generalization, Regularization, Overfitting, Bias.
generalization? If training loss in fact does decrease as expected, it doesn’t automatically mean that whatever the model has learned is also useful. This is where the validation loss comes into play. Things look good if the validation loss decreases alongside the training loss. In that case, the