OPT: Open Pre-trained Transformer Language Models
I am afraid NLP is becoming a game of scale. Large scale models improve the quality but makes it prohibitively expensive to train, and even host such models.