Deep Learning, Artificial Intelligence, Asr, Transformers, Speech Recognition.
shown in figure(2)-right. For the decoder, a similar approach is used using 1-D convolutions over embeddings of previously predicted words (shown in figure(2)-left with N 1-D convolutional layers in each decoder convolutional block). 1.2. Overall Architecture The standard convolutional Transformer