Topic Modeling, Data Science, Machine Learning, NLP, Tips And Tricks.
school. NLTK is notoriously slow. I haven’t run my own comparisons, but this person reports a 20× speedup in tokenizing using spaCy instead of NLTK. Surprisingly, it’s not clear if LDA even benefits from stemming or lemmatization. I’ve seen arguments and experiments go both ways. This paper claims