Machine Learning, Generalization, Regularization, Overfitting, Bias.
large number of parameters, like deep neural networks. Overfitting can happen after a certain number of training iterations. A large gap between training and validation loss is a hint that the model does not generalize well and you may want to try to narrow that gap (graphic below). The simplest