Decision Tree, Entropy, Information Gain, Gini Index.
in different Decision Tree algorithms. To add to the confusion, it is not clear which one is the preferred approach. So, one has to have an understanding of both. Let us begin with Entropy and Information Gain criterion What is Entropy? Entropy is a term that comes from physics and means a measure