Decision Tree, Cart, Machine Learning.
1/3*log(1/3)=0.91 E(feature_2==2)= — 2/3*log(2/3) — 1/3*log(1/3)=0.91 E(feature_2==3)= — 3/4*log(3/4) — 1/4*log(1/4)=0.81 For Feature 2, the weighted average= 3/10*0.91+3/10*0.91+4/10*0.81=0.87 So, Information Gain for feature 2= 0.97–0.87=0.1 Now, we found information gain at the point for feature