6

Table 3: Dimensionality details of Distil-Whisper checkpoints.

Model
distil-medium.en
distil-large-v2

Enc. Layers Dec. Layers Width Heads Params. / M
394
756

1024
1280

24
32

16
20

2
2

Table 4: Summary of the OOD datasets used for short and long-form evaluation.
Dataset

Speakers Domain

Licence

Size / h

CHiME-4
Earnings-22
FLEURS
SPGISpeech

Earnings-21
Earnings-22
Meanwhile
Rev 16

Short-Form
87 News broadcast

unknown

Financial meetings

3 Narrated Wikipedia CC-BY-4.0

unknown

Financial meetings

User Agreement

LDC
CC-BY-SA-4.0

Long-Form

unknown
unknown

Financial meetings
Financial meetings

1 TV show
Podcasat

unknown

CC-BY-SA-4.0
CC-BY-SA-4.0
User Agreement
CC-BY-4.0

7
115
2
100

39
115
1
16

7.3 SHORT-FORM EVALUATION
DISTIL-WHISPER