Machine Learning, Unsupervised Learning, Mnist, Deep Learning, Towards Data Science.
(BIC) or the Akaike Information Criteria (AIC) there are algorithms who can do this selection for us (without having to perform a different fit for each number of components). One of them was suggested in this paper Unsupervised Learning of Finite Mixture Models To fit the Gaussian Mixture Model,