Towards Data Science, Neural Networks, Deep Learning, Machine Learning, Naturallanguageprocessing.
When this sentence is fed to a computer, it considers each word as a token t, and each token has a word embedding V. But these word embeddings have no context. So the idea is to apply some kind of weighing or similarity to obtain final word embedding Y, which has more context than the initial