Decision Tree, Entropy, Information Gain, Gini Index.
classes are divided equally would be 1. Entropy is measured by the formula: Where the pi is the probability of randomly selecting an example in class i. Let us understand this a bit better in the context of our example. So, the initial entropy of at the parent node is given by the probability of