Shannon then proceeds to define a quantitative measure of information as he realizes that the amount of information in some message must be tied up in the design of the machine which could be used to generate similar-looking sequences.