Decision Tree, Entropy, Information Gain, Gini Index.
average of all the sub nodes that a parent node splits into. Thus, in our example this would be 2 sub nodes for Working Status and 3 sub nodes for Student Background. 4. Information Gain: Parent Node Calculations First we will calculate parent node entropy using the formula above. Use any log2