Philosophy, Information Theory, Energy, Thermodynamics.
Shannon calculated that the measure of information entropy associated with each possible data value is the negative logarithm of the probability mass function for the value: Entropy measures the expected amount of information conveyed by identifying the outcome of a random event, where the possible