Topic Modeling, Data Science, Machine Learning, NLP, Tips And Tricks.
once. If we have a million data points, IRLS takes 10¹⁸ units of time. Using SGD, we can sample 1,000 data points in each iteration and run it for 1,000 iterations to approximate the exact IRLS solution, which takes up 10⁹ x 10³ = 10¹² units of time. In this scenario, SGD runs a million times