 Model details  Whisper is a Transformer based encoder-decoder model, also referred to as a _sequence-to-sequence_ model.  It was trained on 680k hours of labelled speech data annotated using large-scale weak supervision.   The models were trained on either English-only data or multilingual data. The English-only models were trained  on the task of speech recognition. The multilingual models were trained on both speech recognition and speech  translation. For speech recognition, the model predicts transcriptions in the *same* language as the audio.  For speech translation, the model predicts transcriptions to a *different* language to the audio.  Whisper checkpoints come in five configurations of varying model sizes. The smallest four are trained on either English-only or multilingual data. The largest checkpoints are multilingual only. All ten of the pre-trained checkpoints  are available on the [Hugging Face Hub](https://huggingface.co/models?search=openai/whisper). The  checkpoints are summarised in the following table with links to the models on the Hub:  | Size     | Parameters | English-only                                         | Multilingual                                        | |----------|------------|------------------------------------------------------|-----------------------------------------------------| | tiny     | 39 M       | [✓](https://huggingface.co/openai/whisper-tiny.en)   | [✓](https://huggingface.co/openai/whisper-tiny)     | | base     | 74 M       | [✓](https://huggingface.co/openai/whisper-base.en)   | [✓](https://huggingface.co/openai/whisper-base)     | | small    | 244 M      | [✓](https://huggingface.co/openai/whisper-small.en)  | [✓](https://huggingface.co/openai/whisper-small)    | | medium   | 769 M      | [✓](https://huggingface.co/openai/whisper-medium.en) | [✓](https://huggingface.co/openai/whisper-medium)   | | large    | 1550 M     | x                                                    | [✓](https://huggingface.co/openai/whisper-large)    | | large-v2 | 1550 M     | x                                                    | [✓](https://huggingface.co/openai/whisper-large-v2) |  