Machine Learning, Transformers, Ashish Vaswani, Lstm, Recurrent Neural Network.
Deep Learning | Winter 2019 | Lecture 14 — Transformers and Self-Attention In convolutions, we have different transformations depending on the relative distance. Thus it is easy to model distance-dependant features. (who, did what?, to whom?) However, with a single attention layer, we have the same