Machine Learning, Transformers, Ashish Vaswani, Lstm, Recurrent Neural Network.
able to look forward. (must try to predict what comes next) Thus, we use a mask on the inputs (to introduce causality). Suppose I want to compare myself to my neighborhood. First I must generate a query(question) and each member of my neighborhood must generate a key. Linear transformations used to