Machine Learning, Transformers, Ashish Vaswani, Lstm, Recurrent Neural Network.
linear transformation everywhere. Thus, we must use multiple attention heads. An attention head acts as a feature detector (carries a separate linear transformation). Thus, we can use separate attention heads to capture who, did what?, and to whom? pieces separately. We operate all these attention