Data Science, Machine Learning, NLP, Word Embeddings, AI.
represented each word as a vector of numbers. Plenty of NLP projects have done just this, but the end results can be mediocre, especially when the training dataset is small. This is because one-hot vectors aren’t a great input representation method. Why is one-hot encoding of words sub-optimal? The