Machine Learning, Artificial Intelligence, Data Science.
p) is used, we will either get one of the local optimal in Diagram b or c. Source For KL(p, q), we want q(x) to be non-zero if p(x) is non-zero. Otherwise, if q(x) is small, the KL value will be high. Therefore, it tries to cover what p will cover. For KL(q, p), if P(x) is zero, we want Q(x) to be