text: In the field of statistics, the Neyman–Pearson lemma states that the most powerful way to distinguish between the two distributions  and  based on an observation  (drawn from one of them) is through the log of the ratio of their likelihoods:  . The KL divergence is the expected value of this statistic if  is actually drawn from . Kullback motivated the statistic as an expected log likelihood ratio.