Artificial Intelligence, Research, Machine Learning, NLP.
Aurelien Rodriguez, Armand Joulin, Edouard Grave, Guillaume Lample ❓ Why → A new set of base checkpoints to build upon. Well, if you work in academia! 💡 Key insights → These new language models from Meta are pretty boring to be fair: the standard Transformers with rotatory position embeddings,