Dataset

TED-LIUM

Earnings-21

Earnings-22

Meanwhile

Rev 16

ID Average

OOD Average

Average

Metric wav2vec2-large-960h
157
5-Dup.
1.7
IER
6.0
SER
1.9
DER
WER
9.6
7938
5-Dup.
5.2
IER
20.9
SER
4.3
DER
30.4
WER
20869
5-Dup.
IER
8.5
26.8
SER
4.8
DER
40.1
WER
858
5-Dup.
1.5
IER
11.9
SER
3.0
DER
16.4
WER
2220
5-Dup.
4.2
IER
16.1
SER
6.1
DER
WER
26.4
157
5-Dup.
1.7
IER
6.0
SER
1.9
DER
9.6
WER
7971
5-Dup.
4.8
IER
18.9
SER
4.6
DER
28.3
WER
6408
5-Dup.
4.2
IER
SER
16.4
4.0
DER
WER
24.6

tiny.en
522
2.1
2.2
2.2
6.4
19294
4.1
8.2
5.3
17.5
65599
6.5
11.6
6.0
24.1
1379
5.7
9.1
1.6
16.4
6981
4.2
6.8
6.4
17.4
587
2.4
2.1
2.2
6.8
23313
5.1
8.9
4.8
18.9
18755
4.5
7.6
4.3
16.4

base.en
557
2.1
1.6
1.9
5.6
19629
3.2
6.0
5.3
14.5
63041
4.8
8.5
6.0
19.4
1406
5.2
6.7
1.5
13.4
6800
3.8
5.3
6.3
15.4
671
2.6
1.6
1.9
6.0
22719
4.3
6.6
4.8
15.7
18287
3.8
5.6
4.2
13.7
DISTIL-WHISPER