Decision Tree, Entropy, Information Gain, Gini Index.
where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. https://en.wikipedia.org/wiki/Entropy In information theory, the entropy of a random variable is the average level of “information”, “surprise”, or