Towards Data Science, Neural Networks, Deep Learning, Machine Learning, Naturallanguageprocessing.
weights (W11 to W19) are also normalized to have a sum of 1. Next, these weights are multiplied with the initial embeddings of all the words in the sentence. W11 V1 + W12 V2 + …. W19 V9 = Y1 W11 to W19 are all weights that have the context of the first word V1. So when we are multiplying these