<p>Yes, Transformers can be used to work with audio data, such as audio processing (audio classification, speaker identification, etc) (<a href="https://arxiv.org/pdf/2005.08575.pdf" rel="nofollow noreferrer">Audio ALBERT</a>), speech-to-text (<a href="https://arxiv.org/pdf/2001.02674.pdf" rel="nofollow noreferrer">Streaming Automatic Speech Recognition with the Transformer Model</a>), and text-to-speech (<a href="https://arxiv.org/pdf/1809.08895.pdf" rel="nofollow noreferrer">Neural Speech Synthesis with Transformer Network</a>).</p>

CC BY-SA 4.0
2020-12-11T07:34:58.260Z
2020-12-11T07:34:58.260Z
user3667125
<p>Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?</p>

<reference-request><applications><transformer><sequence-modeling><audio-processing>
Can we use transformers for audio classification tasks?
Isuru Sachitha
# Can we use transformers for audio classification tasks?

(Asked by: username_0 on 2020-12-10)

Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?

**Tags:** reference-request, applications, transformer, sequence-modeling, audio-processing


---

## 1 answers

### Answer by username_1 on 2020-12-11. Score: 1 | Accepted answer

Yes, Transformers can be used to work with audio data, such as audio processing (audio classification, speaker identification, etc) ([Audio ALBERT](https://arxiv.org/pdf/2005.08575.pdf)), speech-to-text ([Streaming Automatic Speech Recognition with the Transformer Model](https://arxiv.org/pdf/2001.02674.pdf)), and text-to-speech ([Neural Speech Synthesis with Transformer Network](https://arxiv.org/pdf/1809.08895.pdf)).


---

