Machine Learning, Model Selection, Hyperparameter Tuning, Learning Curve, Cross Validation.
data is all we have? How do we do model selection and evaluation in this case? Model evaluation does not change. We still need a test set on which we can estimate the generalization error of the final selected model. Hence, we split the data into two sets, a training and a test set. What changes