Deep Learning, Artificial Intelligence, Asr, Transformers, Speech Recognition.
and it takes about 24 hours to perform all 80 epochs on 2 machines each with 8 GPUs with 16GB of memory. Beam size of 5 is used. 2. Results 2.1. Dataset LibriSpeech dataset, containing 1000h of training data with development and test sets split into simple (“clean”) and harder (“other”) subsets, is