Machine Learning, Model Selection, Hyperparameter Tuning, Learning Curve, Cross Validation.
have been selected on the basis of all training data introduces a dependence between training and validation folds. This contradicts the assumption of independence, which is implied when we use data for validation. By doing preprocessing such as feature selection in the inner CV loop, however, we