NLP, Transfer Learning, Language Model, Ulmfit, Text Classification.
complexity to your model as well as a huge training time. So at first glance, once I had retrieved all Wikipedia and Common Crawl data, I found myself with much more than 100 millions of tokens so I had to pick and choose the most relevant documents to train my model with. The goal of my