Essential Math, Editors Pick, Mathematics, Data Science, Machine Learning.
today”, this is less informative than if she tells you: “It is raining today”. For this reason, it can be helpful to think of the Shannon information as the amount of surprise associated with an outcome. You’ll also see in this section why it is also a quantity of information, and why likely events