good portion of the development set is less than 5%. We then train a linear classiﬁer to accurately
predict bad examples given the input features generated from the speech recognizer. We ﬁnd the
following features useful: the raw CTC cost, the CTC cost normalized by the sequence length,
the CTC cost normalized by the transcript length, the ratio of the sequence length to the transcript
length, the number of words in the transcription and the number of characters in the transcription.
For the English dataset, we ﬁnd that the ﬁltering pipeline reduces the WER from 17% to 5% while
retaining more than 50% of the examples.
5.2 Data Augmentation
We augment our training data by adding noise to increase the effective size of our training data
and to improve our robustness to noisy speech [26]. Although the training data contains some
intrinsic noise, we can increase the quantity and variety of noise through augmentation. Too much
noise augmentation tends to make optimization difﬁcult and can lead to worse results, and too little
noise augmentation makes the system less robust to low signal-to-noise speech. We ﬁnd that a good
balance is to add noise to 40% of the utterances that are chosen at random. The noise source consists
We show that an end-to-end deep learning approach can be used to recognize
either English or Mandarin Chinese speech--two vastly different languages.
Because it replaces entire pipelines of hand-engineered components with neural
networks, end-to-end learning allows us to handle a diverse variety of speech
including noisy environments, accents and different languages. Key to our
approach is our application of HPC techniques, resulting in a 7x speedup over
our previous system. Because of this efficiency, experiments that previously
took weeks now run in days. This enables us to iterate more quickly to identify
superior architectures and algorithms. As a result, in several cases, our
system is competitive with the transcription of human workers when benchmarked
on standard datasets. Finally, using a technique called Batch Dispatch with
GPUs in the data center, we show that our system can be inexpensively deployed
in an online setting, delivering low latency when serving users at scale.
Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper Bryan Catanzaro Jingdong Chen Mike Chrzanowski Adam Coates Greg Diamos Erich Elsen Jesse Engel Linxi Fan Christopher Fougner Tony Han Awni Hannun Billy Jun Patrick LeGresley Libby Lin Sharan Narang Andrew Ng Sherjil Ozair Ryan Prenger Jonathan Raiman Sanjeev Satheesh David Seetapun Shubho Sengupta Yi Wang Zhiqian Wang Chong Wang Bo Xiao Dani Yogatama Jun Zhan Zhenyao Zhu