Machine Learning, Model Selection, Hyperparameter Tuning, Learning Curve, Cross Validation.
is not the case, all estimates will be plain wrong. This is why it is essential to ensure before model building that the distribution of the data is not affected by partitioning your data. Imagine, for example, that you are dealing with imbalanced data, e.g. a data set with a binary target which is