Topic Modeling, Data Science, Machine Learning, NLP, Tips And Tricks.
faster! SGD is expected to be imperfect as it merely approximates the optimal IRLS solution, but it usually gets close enough. With SVI, that intuition goes out the window: “online” provides a better fit than “batch” AND runs much faster. It is strictly better. There is no single justification to