Essential Math, Editors Pick, Mathematics, Data Science, Machine Learning.
because the information of Q(x) is weighted according to the distribution of P(x), which is similar to Q(x). However, in the right panel, P(x) and Q(x) are different. This results in a larger cross-entropy, because probabilities associated with a large quantity of information have a small weight,