T
E
D
-
L
I
U
M
3

5.5
6.8
4.6
4.8
4.6
4.2
3.6
3.8
3.8
3.5

17.6
12.8
7.2
10.1
8.8
8.1
8.1
4.0
5.3

M

e
a
n
w
h
i
l
e

12.8
15.5
9.4
12.2
6.0
6.9
5.2
5.4
5.3
5.1

27.7
19.7
11.4
16.4
15.2
12.9
12.5
9.8
10.6

K
i
n
c
a
i
d
4
6

13.8
16.7
11.2
12.2
9.4
10.1
8.9
8.6
8.8
8.8

39.3
32.9
21.1
27.4
22.9
22.4
22.9
13.1
17.1

R
e
v
1
6

15.1
17.0
13.2
14.5
12.0
12.1
11.9
11.4
11.0
11.3

35.2
29.8
21.3
26.4
23.4
23.4
23.2
14.5
19.8

E
a
r
n
i
n
g
s
-
2
1

17.0
18.7
12.5
13.5
10.8
11.1
10.2
10.3
10.3
9.7

45.7
37.3
21.7
30.4
23.0
23.0
23.1
12.6
16.2

E
a
r
n
i
n
g
s
-
2
2

22.0
24.4
16.6
18.4
14.0
14.3
13.3
13.2
13.4
12.6

57.1
46.8
28.0
40.1
31.0
30.6
31.3
17.6
19.7

C
O
R
A
A
L

30.3
33.1
25.2
26.9
21.9
22.3
20.6
20.3
20.4
19.6

55.4
49.1
36.7
43.5
36.8
37.9
38.1
25.1
38.9

Table 16. Long-form English transcription WER (%)

Robust Speech Recognition via Large-Scale Weak Supervision
E. Training Dataset Statistics

27

Figure 11. Training dataset statistics
RobustSpeechRecognitionviaLarge-ScaleWeakSupervision