Quora Question Pairs
Accuracy
BERT (single model)
Question Answering
72.1
SQuAD1.1 dev
F1
BERT base (single)
Question Answering
88.5
SQuAD1.1 dev
EM
BERT base (single)
Question Answering
80.8
SQuAD1.1 dev
EM
BERT large (single)
Question Answering
84.1
SQuAD1.1 dev
F1
BERT large (single)
Question Answering
90.9
SQuAD1.1 dev
EM
BERT large (+TriviaQA)
Question Answering
84.2
SQuAD1.1 dev
F1
BERT large (+TriviaQA)
Question Answering
91.1
SQuAD2.0 dev
EM
BERT large
Question Answering
78.7
SQuAD2.0 dev
F1
BERT large
Question Answering
81.9
SWAG
Dev
BERT Base
Common Sense Reasoning
81.6
SWAG
Dev
BERT Large
Common Sense Reasoning
86.6
SWAG
Test
BERT Large
Common Sense Reasoning
86.3
CoNLL 2003 (English)
F1
BERT Large
Named Entity Recognition
92.8
CoNLL 2003 (English)
F1
BERT Base
Named Entity Recognition
92.4