Decision Tree, Cart, Machine Learning.
3/3log(3/3) = — 1log1=0 E(feature_1==3)= — 2/3*log(2/3) — 1/3*log(1/3)=0.91 For Feature 1, the weighted average= 4/10*0.81+3/10*0+3/10*0.91=0.597 Information Gain= 0.97–0.597=0.313 Again, let’s do the same for feature 2: For Feature 2: For Feature 2: E(feature_2==1)= — 2/3*log(2/3) —