Machine Learning, Clustering, Gaussian Mixture Model.
Because θ depends on z, but z is hidden, we cannot directly apply maximum likelihood estimation to solve the argmax problem. Let us also define q(z) as any arbitrary distribution of the latent variable z. As such, we have: It should be clear that Eq 1 is derived from Bayes’ rule. Rearranging terms