NLP, Transfer Learning, Language Model, Ulmfit, Text Classification.
hyperparameters. To simplify the problem at the beginning, the right way to go is to try to overfit on a single batch of data. The idea here is to make sure that given some data, your model is able to interpret its complexity and perform well on the training set. Here are all the things I tried :