Data Science, Machine Learning, Statistics, Open Source, Crossvalidation.
quite. There’s a methodological mistake here. We’re brute-forcing our way into finding the best model. This paper demonstrated that it’s possible to end up with an overly optimistic generalization error (due to overfitting) when we use the (vanilla) cross-validation method to optimize