NLP, Transfer Learning, Language Model, Ulmfit, Text Classification.
Data volume Let’s remember that a language model is a model supposed to predict the next word in a text. To do that, our model should have seen a lot of examples to learn the language and be good at speaking it. That being said, it is not useful to go beyond 100 millions of tokens. It only adds