WER calculation. They are free to listen to the audio clip as many times as they like. These workers
are mostly based in the United States, and on average spend about 27 seconds per transcription.
The hand-transcribed results are compared to the existing ground truth to produce a WER. While
the existing ground truth transcriptions do have some label error, this is rarely more than 1%. This
implies that disagreement between the ground truth transcripts and the human level transcripts is a
good heuristic for human level performance.
6.1.1 Model Size
Our English speech training set is substantially larger than the size of commonly used speech
datasets. Furthermore, the data is augmented with noise synthesis. To get the best generalization
error, we expect that the model size must increase to fully exploit the patterns in the data. In Section 3.2 we explored the effect of model depth while ﬁxing the number of parameters. In contrast,
here we show the effect of varying model size on the performance of the speech system. We only
vary the size of each layer, while keeping the depth and other architectural parameters constant. We
evaluate the models on the same Regular and Noisy development sets that we use in Section 3.5.
The models in Table 11 differ from those in Table 3 in that we increase the the stride to 3 and output
We show that an end-to-end deep learning approach can be used to recognize
either English or Mandarin Chinese speech--two vastly different languages.
Because it replaces entire pipelines of hand-engineered components with neural
networks, end-to-end learning allows us to handle a diverse variety of speech
including noisy environments, accents and different languages. Key to our
approach is our application of HPC techniques, resulting in a 7x speedup over
our previous system. Because of this efficiency, experiments that previously
took weeks now run in days. This enables us to iterate more quickly to identify
superior architectures and algorithms. As a result, in several cases, our
system is competitive with the transcription of human workers when benchmarked
on standard datasets. Finally, using a technique called Batch Dispatch with
GPUs in the data center, we show that our system can be inexpensively deployed
in an online setting, delivering low latency when serving users at scale.
Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper Bryan Catanzaro Jingdong Chen Mike Chrzanowski Adam Coates Greg Diamos Erich Elsen Jesse Engel Linxi Fan Christopher Fougner Tony Han Awni Hannun Billy Jun Patrick LeGresley Libby Lin Sharan Narang Andrew Ng Sherjil Ozair Ryan Prenger Jonathan Raiman Sanjeev Satheesh David Seetapun Shubho Sengupta Yi Wang Zhiqian Wang Chong Wang Bo Xiao Dani Yogatama Jun Zhan Zhenyao Zhu