Essential Math, Editors Pick, Mathematics, Data Science, Machine Learning.
lower entropy for a biased coin. Let's plot the entropy for various coin biases, from a coin landing only as 'tails' to a coin landing only as 'heads': Figure 3: Entropy as a function of the probability to land “heads”. Figure 3 shows that the entropy increases until you reach the more uncertain