SQuAD1.1
EM
SpanBERT (single model)
Question Answering
88.8
SQuAD1.1
F1
SpanBERT (single model)
Question Answering
94.6
SQuAD2.0
EM
SpanBERT
Question Answering
85.7
SQuAD2.0
F1
SpanBERT
Question Answering
88.7
NewsQA
F1
SpanBERT
Question Answering
73.6
TriviaQA
F1
SpanBERT
Question Answering
83.6
SearchQA
F1
SpanBERT
Open-Domain Question Answering
84.8
HotpotQA
Joint F1
SpanBERT
Question Answering
83
NaturalQA
F1
SpanBERT
Question Answering
82.5
OntoNotes
F1
SpanBERT
Coreference Resolution
79.6
TACRED
Precision
SpanBERT
Relation Extraction
70.8
TACRED
Recall
SpanBERT
Relation Extraction
70.9
TACRED
F1
SpanBERT
Relation Extraction
70.8
CoLA
Accuracy
SpanBERT
Linguistic Acceptability
64.3
SST-2 Binary classification
Accuracy
SpanBERT
Sentiment Analysis
94.8
MRPC
Accuracy
SpanBERT
Semantic Textual Similarity
90.9
STS Benchmark
Pearson Correlation
SpanBERT
Semantic Textual Similarity
0.899
Quora Question Pairs
Accuracy
SpanBERT
Paraphrase Identification
71.9
MultiNLI
Matched
SpanBERT
Natural Language Inference
88.1
QNLI
Accuracy
SpanBERT
Natural Language Inference
94.3
RTE
Accuracy
SpanBERT
Natural Language Inference
79.0
SQuAD2.0 dev
F1
SpanBERT
Question Answering
86.8