CoLA
Accuracy
ERNIE 2.0 Base
Linguistic Acceptability
55.2
CoLA
Accuracy
ERNIE 2.0 Large
Linguistic Acceptability
63.5
SST-2 Binary classification
Accuracy
ERNIE 2.0 Base
Sentiment Analysis
95
SST-5 Fine-grained classification
Accuracy
ERNIE 2.0 Large
Sentiment Analysis
95.6
MRPC
Accuracy
ERNIE 2.0 Base
Semantic Textual Similarity
86.1
MRPC
Accuracy
ERNIE 2.0 Large
Semantic Textual Similarity
87.4
STS Benchmark
Pearson Correlation
ERNIE 2.0 Base
Semantic Textual Similarity
0.876
STS Benchmark
Pearson Correlation
ERNIE 2.0 Large
Semantic Textual Similarity
0.912
Quora Question Pairs
Accuracy
ERNIE 2.0 Base
Question Answering
89.8
Quora Question Pairs
Accuracy
ERNIE 2.0 Large
Question Answering
90.1
MultiNLI
Matched
ERNIE 2.0 Base
Natural Language Inference
86.1
MultiNLI
Matched
ERNIE 2.0 Large
Natural Language Inference
88.7
QNLI
Accuracy
ERNIE 2.0 Base
Natural Language Inference
92.9
QNLI
Accuracy
ERNIE 2.0 Large
Natural Language Inference
94.6
RTE
Accuracy
ERNIE 2.0 Base
Natural Language Inference
74.8
RTE
Accuracy
ERNIE 2.0 Large
Natural Language Inference
80.2
WNLI
Accuracy
ERNIE 2.0 Large
Natural Language Inference
65.1
WNLI
Accuracy
ERNIE 2.0 Large
Natural Language Inference
67.8
CMRC 2018 (Simplified Chinese) Dev
EM
ERNIE 2.0 Base
Chinese Reading Comprehension
69.1
CMRC 2018 (Simplified Chinese) Dev
EM
ERNIE 2.0 Large
Chinese Reading Comprehension
28.5
DRCD (Traditional Chinese) Dev
EM
ERNIE 2.0 Base
Chinese Reading Comprehension
88.5
DRCD (Traditional Chinese)
EM
ERNIE 2.0 Base
Chinese Reading Comprehension
88.0
DRCD (Traditional Chinese) Dev
EM
ERNIE 2.0 Large
Chinese Reading Comprehension
89.7
DRCD (Traditional Chinese)
EM
ERNIE 2.0 Large
Chinese Reading Comprehension
89
DuReader
EM
ERNIE 2.0 Base
Open-Domain Question Answering
61.3
DuReader
EM
ERNIE 2.0 Large
Open-Domain Question Answering
64.2
MSRA Dev
F1
ERNIE 2.0 Base
Chinese Named Entity Recognition
95.2
MSRA
F1
ERNIE 2.0 Base
Chinese Named Entity Recognition
93.8
MSRA Dev
F1
ERNIE 2.0 Large
Chinese Named Entity Recognition
96.3
MSRA
F1
ERNIE 2.0 Large
Chinese Named Entity Recognition
95
XNLI Chinese Dev
Accuracy
ERNIE 2.0 Base
Natural Language Inference
81.2
XNLI Chinese
Accuracy
ERNIE 2.0 Base
Natural Language Inference
79.7
XNLI Chinese Dev
Accuracy
ERNIE 2.0 Large
Natural Language Inference
82.6
XNLI Chinese
Accuracy
ERNIE 2.0 Large
Natural Language Inference
81
ChnSentiCorp Dev
Accuracy
ERNIE 2.0 Base
Chinese Sentiment Analysis
95.7
ChnSentiCorp
Accuracy
ERNIE 2.0 Base
Chinese Sentiment Analysis
95.5
ChnSentiCorp Dev
Accuracy
ERNIE 2.0 Large
Chinese Sentiment Analysis
96.1
ChnSentiCorp
Accuracy
ERNIE 2.0 Large
Chinese Sentiment Analysis
95.8
LCQMC Dev
Accuracy
ERNIE 2.0 Base
Chinese Sentence Pair Classification
90.9
LCQMC
Accuracy
ERNIE 2.0 Base
Chinese Sentence Pair Classification
87.9
LCQMC Dev
Accuracy
ERNIE 2.0 Large
Chinese Sentence Pair Classification
90.9
LCQMC
Accuracy
ERNIE 2.0 Large
Chinese Sentence Pair Classification
87.9
BQ Dev
Accuracy
ERNIE 2.0 Base
Chinese Sentence Pair Classification
86.4
BQ
Accuracy
ERNIE 2.0 Base
Chinese Sentence Pair Classification
85.0
BQ Dev
Accuracy
ERNIE 2.0 Large
Chinese Sentence Pair Classification
86.5
BQ
Accuracy
ERNIE 2.0 Large
Chinese Sentence Pair Classification
85.2
NLPCC-DBQA Dev
MRR
ERNIE 2.0 Base
Chinese Sentence Pair Classification
95.7
NLPCC-DBQA
MRR
ERNIE 2.0 Base
Chinese Sentence Pair Classification
95.7
NLPCC-DBQA Dev
MRR
ERNIE 2.0 Large
Chinese Sentence Pair Classification
95.9
NLPCC-DBQA
MRR
ERNIE 2.0 Large
Chinese Sentence Pair Classification
95.8