Philosophy, Information Theory, Energy, Thermodynamics.
ever played Scrabble, you’d know how limited options would be if we drew the letter “Q”). Every time we communicate a piece of information, the overall entropy, disorder, uncertainty, or whatever you want to call it decreases by a proportional amount or rate. So what is this proportional amount?