Answers.Body: <p>Yes, Transformers can be used to work with audio data, such as audio processing (audio classification, speaker identification, etc) (<a href="https://arxiv.org/pdf/2005.08575.pdf" rel="nofollow noreferrer">Audio ALBERT</a>), speech-to-text (<a href="https://arxiv.org/pdf/2001.02674.pdf" rel="nofollow noreferrer">Streaming Automatic Speech Recognition with the Transformer Model</a>), and text-to-speech (<a href="https://arxiv.org/pdf/1809.08895.pdf" rel="nofollow noreferrer">Neural Speech Synthesis with Transformer Network</a>).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-11T07:34:58.260Z
Answers.LastActivityDate: 2020-12-11T07:34:58.260Z
Answers.UserDisplayName: user3667125
Body: <p>Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?</p>
  
Tags: <reference-request><applications><transformer><sequence-modeling><audio-processing>
Title: Can we use transformers for audio classification tasks?
UserDisplayName: Isuru Sachitha
ThreadText: # Can we use transformers for audio classification tasks?
  
  (Asked by: username_0 on 2020-12-10)
  
  Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?
  
  **Tags:** reference-request, applications, transformer, sequence-modeling, audio-processing
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-12-11. Score: 1 | Accepted answer
  
  Yes, Transformers can be used to work with audio data, such as audio processing (audio classification, speaker identification, etc) ([Audio ALBERT](https://arxiv.org/pdf/2005.08575.pdf)), speech-to-text ([Streaming Automatic Speech Recognition with the Transformer Model](https://arxiv.org/pdf/2001.02674.pdf)), and text-to-speech ([Neural Speech Synthesis with Transformer Network](https://arxiv.org/pdf/1809.08895.pdf)).
  
  
  ---
  
  