Machine Learning, NLP, Bert, Albert, Transformers.
scalability has become the main obstacle in effective training, storing and using them. As a consequence, new LLMs have been recently developed to tackle scalability issues. In this article, we will discuss ALBERT which was invented in 2020 with an objective of significant reduction of BERT