Decision Tree, Entropy, Information Gain, Gini Index.
categorical prediction, we use the modal value for prediction. If it is a numerical prediction (regression tree), we predict the mean value of the target values at each leaf node. Overfitting and Decision Trees Overfitting can be a big challenge with Decision Trees. Even in our toy example, we can