Towards Data Science, Deep Learning, Machine Learning, Neural Networks, Naturallanguageprocessing.
attention to give us a final output. This is shown in figure 8. Figure 8. Multi-Head Attention (source: image created by author) A simpler explanation: The main vector (sentence) contains sub-vectors (words) — with each word having a positional embedding. The attention computation treats each word