 Quantities of information

The mathematical theory of information is based on probability theory and statistics, and measures information with several quantities of information.The choice of logarithmic base in the following formulae determines the unit of information entropy that is used.