Machine Learning, NLP, Bert, Albert, Transformers.
configurations shows how fast models iterated through the training data. The speed values are shown relatively for each model (BERT large is taken as a baseline whose speed equals 1x). The accuracy score was measured on GLUE, SQuAD and RACE benchmarks. Here are the most interesting observations: By