NLP, Transfer Learning, Language Model, Ulmfit, Text Classification.
regularizers that I used for training my model Learning rate: 0.0002 Weight decay: 1e-8 Gradient clipping: 0.25 Results After training my model for 15 epochs, I finally reached an accuracy of 25% and a perplexity of 100. As I said at the beginning, I never intended to use my language model for text