utterance.
6.1.3 Accented Speech
Our source for accented speech is the publicly available V oxForge ( http://www.voxforge.org )
dataset, which has clean speech read from speakers with many different accents. We group these
accents into four categories. The American-Canadian and Indian groups are self-explanatory. The
Commonwealth accent denotes speakers with British, Irish, South African, Australian and New
Zealand accents. The European group contains speakers with accents from countries in Europe that
do not have English as a ﬁrst language. We construct a test set from the V oxForge data with 1024
examples from each accent group for a total of 4096 examples.
Performance on these test sets is to some extent a measure of the breadth and quality of our training
data. Table 14 shows that our performance improved on all the accents when we include more
accented training data and use an architecture that can effectively train on that data. However human
level performance is still notably better than that of DS2 for all but the Indian accent.
6.1.4 Noisy Speech
We test our performance on noisy speech using the publicly available test sets from the recently
completed third CHiME challenge [4]. This dataset has 1320 utterances from the WSJ test set
We show that an end-to-end deep learning approach can be used to recognize
either English or Mandarin Chinese speech--two vastly different languages.
Because it replaces entire pipelines of hand-engineered components with neural
networks, end-to-end learning allows us to handle a diverse variety of speech
including noisy environments, accents and different languages. Key to our
approach is our application of HPC techniques, resulting in a 7x speedup over
our previous system. Because of this efficiency, experiments that previously
took weeks now run in days. This enables us to iterate more quickly to identify
superior architectures and algorithms. As a result, in several cases, our
system is competitive with the transcription of human workers when benchmarked
on standard datasets. Finally, using a technique called Batch Dispatch with
GPUs in the data center, we show that our system can be inexpensively deployed
in an online setting, delivering low latency when serving users at scale.
Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper Bryan Catanzaro Jingdong Chen Mike Chrzanowski Adam Coates Greg Diamos Erich Elsen Jesse Engel Linxi Fan Christopher Fougner Tony Han Awni Hannun Billy Jun Patrick LeGresley Libby Lin Sharan Narang Andrew Ng Sherjil Ozair Ryan Prenger Jonathan Raiman Sanjeev Satheesh David Seetapun Shubho Sengupta Yi Wang Zhiqian Wang Chong Wang Bo Xiao Dani Yogatama Jun Zhan Zhenyao Zhu