Em Algorithm, Machine Learning, Data Mining, Jensens Inequality, Bayes Theorem.
EM algorithm has two steps, expectation and maximization and proceeds iteratively. First the parameters are initialized. The distribution q(z) is updated in the Expectation step holding the parameters θ fixed to θold. This simply involves setting q(z) = p(Z|X, θold). Then the parameters θ are