Decision Tree, Supervised Learning, Python, R, Machine Learning.
students 13 failed and 17 passed. If we break the root node down, the feature test score gets 12 students while the feature attendance gets 18 students. Image by Author How do we decide which node to choose given we have more features in the dataset? We use the entropy formula. Entropy = —