Machine Learning, Model Selection, Hyperparameter Tuning, Learning Curve, Cross Validation.
sets. Note that the caveats regarding imbalanced data also apply here. We set aside each of the K folds one time, as illustrated in Fig. 2. We train as many models as there are different combinations of model hyperparameters on the remaining K-1 folds and compute the validation score on the