Machine Learning, NLP, Bert, Albert, Transformers.
having only 70% of the parameters of BERT large, the xxlarge version of ALBERT achieves a better performance on downstream tasks. ALBERT large achieves comparable performance, compared to BERT large, and is faster 1.7x times due to the massive parameter size compression. All ALBERT models have an