Machine Learning, Statistics, Algorithms, Mathematics, Data Science.
lower bound for the observed log-likelihood above. We tweak the expansion a little: Since the Kullback-Leibler Divergence is always positive, we again obtain another lower bound. In this version, it is easy to see that in order to maximise F (the observed likelihood in the previous section) with