Deep Learning, Artificial Intelligence, Asr, Transformers, Speech Recognition.
right corner of each block). On the decoder side, a separate multi-head attention layer is used to aggregate encoder context for each decoder Transformer block. Convolutional layers are added below the Transformer layers, and no more positional encodings are used. The model learns an acoustic