4
6.9
9.6
16.8
33.8
52.0
12.1
20.8

16
2.5
3.7
8.0
18.5
33.8
10.4
20.1

Table 25: Real time factor (RFT) with and without FA for batch sizes 1, 4 and 16. Inference speed
is measured on a 16GB T4 GPU with PyTorch 2.0. RTF is expressed in 10-3.

Model

Avg. OOD WER
DISTIL-WHISPER