Decision Tree, Cart, Machine Learning.
provide. For instance for feature 1, We can see if we select the condition “Feature 1==2”, we can successfully separate label 2 from the dataset purely. Now, Entropy (E(s))= — 4/10*log(4/10) — 6/10*log(6/10)=0.97 For Feature 1: E(feature_1==1)= — 3/4*log(3/4) — 1/4*log(1/4)=0.81 E(feature_1==2)= —