Machine Learning, AI, NLP, Programming, Deep Dives.
RoBERTa is too big and may produce some overfitting with this dataset. Remember, if you’re working with a different language then look for a base model that has been trained on a corpus from at least a similar language. If you’re working with nordic languages I can recommend