Data Science, Machine Learning, NLP, Word Embeddings, AI.
size issues can be thought of as technical problems, and maybe the similarity point is more of a “nice to have”. What’s the most important problem that one-hot vectors have, that dense embeddings solve? The core problem that embeddings solve is generalisation. The generalisation issue. If as assume