Machine Learning, Neural Networks, Statistics, Data Science, AI.
network’s parameters θ. Since the solution space of deep neural networks is very rich, this method of learning might overfit to our training data. This overfitting may result in significant generalization error and bad performance on unseen data (or test data, in the context of model development),