Machine Learning, Deep Learning, Data Science.
called an embedding lookup. Using the vector from the word embedding helps prevent the resulting activations being very sparse. As if the input was the one hot encoded vector, which is all zeros apart from one element, the majority of the activations would also be zero. This would then be difficult