Decision Tree, Entropy, Information Gain, Gini Index.
variable — Pass and Fail in our example P(i) represents the ratio of Pass/Total no. of observations in node. So, Let’s take an example from the decision tree above. Let’s begin with the root node and calculate the Gini Index for each of the splits. The Gini Index has a minimum (highest level of