Machine Learning, Transformers, Ashish Vaswani, Lstm, Recurrent Neural Network.
parallelization. Moreover, they do not accurately represent long and short-term dependencies. (language hierarchy) Researchers tried to use convolutional neural networks to represent sequence models. In these models, language is processed depthwise. Convolutions are trivially parallel and can