diminishing returns when further scaling to the full dataset
size.
The general trend across tasks of diminishing returns when
moving from 54,000 hours to our full dataset size of 680,000
hours could suggest that the current best Whisper models are
under-trained relative to dataset size and performance could
be further improved by a combination of longer training
and larger models. It could also suggest that we are nearing
the end of performance improvements from dataset size
scaling for speech recognition. Further analysis is needed to
characterize “scaling laws” for speech recognition in order
to decided between these explanations.

4.3. Multitask and Multilingual Transfer
RobustSpeechRecognitionviaLarge-ScaleWeakSupervision