Machine Learning, NLP, Bert, Albert, Transformers.
off for achieving higher accuracy. Ultimately, the NLP domain never stops and is constantly progressing towards new optimisation techniques. It is very likely that the speed rate in ALBERT will be improved in the near future. The paper’s authors have already mentioned methods like sparse attention