Machine Learning, NLP, Information Technology, Data, AI.
only use the attributes Y. We do our best by increasing the mutual information between X and Y, but according to the theorem this does not guarantee an increase also in . , you may remember, only constitutes an upper bound over . Thus, in the first steps, the information gain is significant and