Machine Learning, Programming, Artificial Intelligence, Data Science, Technology.
how much “information” a feature gives us about a class. ID3 will always try to maximize this metric, which means that the attribute with the highest Information Gain will split first. Information Gain is directly linked to the concept of Entropy, which is the measure of the amount of uncertainty