The Kullback–Leibler divergence was introduced by Solomon Kullback and Richard Leibler in 1951 as the directed divergence between two distributions; Kullback preferred the term discrimination information.[3] The divergence is discussed in Kullback's 1959 book, Information Theory and Statistics.[2]