CoLA
Accuracy
T5-Base
Linguistic Acceptability
51.1
CoLA
Accuracy
T5-Large
Linguistic Acceptability
61.2
MRPC
F1
T5-Large
Semantic Textual Similarity
92.4
CoLA
Accuracy
T5-3B
Linguistic Acceptability
67.1
SST-2 Binary classification
Accuracy
T5-3B
Sentiment Analysis
97.4
STS Benchmark
Pearson Correlation
T5-11B
Semantic Textual Similarity
0.925
CoLA
Accuracy
T5-11B
Linguistic Acceptability
70.8
MRPC
F1
T5-11B
Semantic Textual Similarity
91.9
MultiNLI
Matched
T5-Small
Natural Language Inference
82.4
WNLI
Accuracy
T5-Base
Natural Language Inference
78.8
RTE
Accuracy
T5-3B
Natural Language Inference
91.1
QNLI
Accuracy
T5-11B
Natural Language Inference
96.7
WNLI
Accuracy
T5-11B
Natural Language Inference
93.2
SQuAD1.1 dev
EM
T5-Small
Question Answering
79.1
SQuAD1.1 dev
F1
T5-Small
Question Answering
87.24
SQuAD1.1 dev
EM
T5-Base
Question Answering
85.44
SQuAD1.1 dev
F1
T5-Base
Question Answering
92.08
SQuAD1.1 dev
EM
T5-Large
Question Answering
86.66
SQuAD1.1 dev
F1
T5-Large
Question Answering
93.79
SQuAD1.1 dev
F1
T5-3B
Question Answering
94.95
SQuAD1.1 dev
F1
T5-11B
Question Answering
95.64
ReCoRD
F1
T5-11B
Question Answering
93.3
Words in Context
Accuracy
T5-11B
Word Sense Disambiguation
76.1
WMT2014 English-German
BLEU score
T5-11B
Machine Translation
32.1
WMT2014 English-French
BLEU score
T5
Machine Translation
43.4
CNN / Daily Mail
ROUGE-1
T5-11B
Document Summarization
43.52
CNN / Daily Mail
ROUGE-2
T5-11B
Document Summarization
21.55
CNN / Daily Mail
ROUGE-L
T5-11B
Document Summarization
40.69