Deep Learning, Artificial Intelligence, Asr, Transformers, Speech Recognition.
model used in most experiments has the following configuration: 2 2-D convolutional blocks, each with two conv. layers with kernel size=3, max-pooling kernel=2. The first block has 64 feature maps while the second has 128. 10 encoder Transformer blocks all with Transformer dim=1024, 16 heads,