Entropy, Thermodynamics, Machine Learning.
Non-Predictive Information. Take one given learning algorithm and associated with it, a data set. The question I am interested in is then, after the learning step has occurred, how much of the information acquired by the learning algorithm is useful (predictive-information)? And therefore how much