This will be short but sweet. In the spirit of @J.R answer- (in
particular the block section)- the information content of any
"word" is most certainly less than that in an equivalent random
amount of characters in that word (if one is writing) or
syllables (if one is speaking.) As anyone who reads @J.R. block
passage will agree, predictability is assured- providing we are
on the same rational basis. Nothing more is required- anyone
with any questions: look up information theory. a definite
answer as requested. ok so it seems i need to do all the work:
Entropy is defined in the context of a probabilistic model.
Independent fair coin flips >have an entropy of 1 bit per flip.
A source that always generates a long string of B's has >an
entropy of 0, since the next character will always be a 'B'. The
entropy rate of a data source means the average number of bits
per symbol needed to encode it. Shannon's experiments with human
predictors show an information rate of between 0.6 and 1.3 bits
per character, depending