Machine Learning, Cross Validation, K Fold, Grid Search, Random Search.
with each fold used as the validation set once. The final performance is the average of the performance across all K iterations. Leave-One-Out Cross-Validation: A special case of K-Fold Cross-Validation where K equals the number of data points. Each data point is used as a validation set exactly