Towards Data Science, Neural Networks, Deep Learning, Machine Learning, Naturallanguageprocessing.
should illustrate this better. Figure 3. Finding weights and Obtaining final embedding (Source: Image created by author) As we see in figure 3, we first find the weights by multiplying (dot product) the initial embedding of the first word with the embedding of all other words in the sentence. These