Philosophy, Information Theory, Energy, Thermodynamics.
informative value of a communicated message depends on the degree to which the content of the message is surprising. A great example of this in practice is the use of frequency of letters in language. Probabilistically, if the instance of a letter is one event, then the most likely outcome of every