Em Algorithm, Machine Learning, Data Mining, Jensens Inequality, Bayes Theorem.
equality when the KL divergence is zero, or when q(z) = p(Z|X, θ). Maximizing the log-likelihood can be indirectly achieved by maximizing L(q, θ). There are two options for maximizing L, by varying q, or by varying the parameters θ. It is simpler to vary each independently. As the name implies, the