Towards Data Science, Neural Networks, Deep Learning, Machine Learning, Naturallanguageprocessing.
words similar with respect to the first word V1. We then send V1 as the Query word. This query word will then do a dot product with all the words in the sentence (V1 to V9) — and these are the Keys. So the combination of the Query and the Keys give us the weights. These weights are then multiplied