Machine Learning, Deep Learning, Data Science.
of weights, with a row for each word/token in the vocabulary Matrix dot product multiplication with a one hot encoded vector outputs a row of the matrix representing activations from that word. It is essentially a row lookup in the matrix and is computationally more efficient to do that, this is