RACE
Accuracy
XLNet
Reading Comprehension
85.4
RACE
Accuracy (Middle)
XLNet
Reading Comprehension
88.6
RACE
Accuracy (High)
XLNet
Reading Comprehension
84.0
ClueWeb09-B
nDCG@20
XLNet
Document Ranking
31.10
ClueWeb09-B
ERR@20
XLNet
Document Ranking
20.28
SQuAD2.0 dev
EM
XLNet (single model)
Question Answering
87.9
SQuAD2.0 dev
F1
XLNet (single model)
Question Answering
90.6
SQuAD1.1 dev
EM
XLNet (single model)
Question Answering
89.7
SQuAD1.1 dev
F1
XLNet (single model)
Question Answering
95.1
SQuAD2.0
EM
XLNet (single model)
Question Answering
87.926
SQuAD2.0
F1
XLNet (single model)
Question Answering
90.689
SQuAD1.1
EM
XLNet (single model)
Question Answering
89.898
SQuAD1.1
F1
XLNet (single model)
Question Answering
95.080
IMDb
Accuracy
XLNet
Text Classification
96.8
Yelp-2
Accuracy
XLNet
Text Classification
98.63
Yelp-5
Accuracy
XLNet
Text Classification
72.95
DBpedia
Error
XLNet
Text Classification
0.6
AG News
Error
XLNet
Text Classification
4.45
Amazon-2
Error
XLNet
Text Classification
2.11
Amazon-5
Error
XLNet
Text Classification
31.67
MultiNLI
Matched
XLNet (single model)
Natural Language Inference
90.8
QNLI
Accuracy
XLNet (single model)
Natural Language Inference
94.9
Quora Question Pairs
Accuracy
XLNet (single model)
Question Answering
92.3
RTE
Accuracy
XLNet (single model)
Natural Language Inference
85.9
SST-2 Binary classification
Accuracy
XLNet (single model)
Sentiment Analysis
97
MRPC
Accuracy
XLNet (single model)
Semantic Textual Similarity
90.8
CoLA
Accuracy
XLNet (single model)
Linguistic Acceptability
69
STS Benchmark
Pearson Correlation
XLNet (single model)
Semantic Textual Similarity
92.5