 For the classical Kullback–Leibler divergence, it can be shown that

and the equality holds if and only if "P" = "Q".Colloquially, this means that the uncertainty calculated using erroneous assumptions is always greater than the real amount of uncertainty.To show the inequality, we rewrite

Notice that log is a concave function.