10e+1910e+2010e+2110e+22FLOPs training on english speech recognition8101214161820Average WER on 11 english speech recognition datasetsEnglish OnlyMultilingual and Multitask01020304050Relative WER reduction compared to FairSpeech's normalizer (%)CORAALCommonVoice9.enAMI-SDM1CommonVoice5.1Fleurs.en_usAMI-IHMArtieLibriSpeechTED-LIUM3VoxPopuli.enWSJCallHomeSwitchboardOpen-source modelsWhisper modelsRobust Speech Recognition via Large-Scale Weak Supervision

13

3
M
U
I
L
-
D
E
T

e
l
i
h
w
n
a
e

M

6
4
d
i
a
c
n
i
K

6
1
v
e
R

1
2
-
s
g
n
i
n
r
a
E

2
2
-
s
g
n
i
n
r
a
E

L
A
A
R
O
C

e
g
a
r
e
v
A

11.0
10.6
10.6
10.2
10.0
10.0

Greedy decoding only
+ Beam search
+ Temperature fallback
+ Voice activity detection
+ Previous text conditioning
+ Initial timestamp constraint

3.95 5.16 9.69 11.7 10.7 14.0 22.0
4.16 5.71 9.42 11.5 10.2 13.4 20.0
4.16 5.71 9.42 11.5 10.2 13.4 20.0
3.56 4.61 9.45 11.4 10.1 13.2 19.4
3.42 6.16 8.72 11.0 9.63 13.3 18.1
3.51 5.26 8.41 11.5 9.73 12.6 19.1
RobustSpeechRecognitionviaLarge-ScaleWeakSupervision