Essential Math, Editors Pick, Mathematics, Data Science, Machine Learning.
denoted as I and is called the Shannon information, information content, self-information, or surprisal. The main idea is that likely events convey less information than unlikely events (which are thus more surprising). For instance, if a friend from Los Angeles, California tells you: “It is sunny