Deep Learning, Naturallanguageprocessing, Embedding, Word2vec, Fasttext.
Representations like [ 0 0 0 1 0 0 0 …] will generate by one-hot encoding. The size of the vector is the size of the vocabulary. With this representation, large sparse vectors are frequently produced. Distributed Representations When a word’s representation is not independent or mutually exclusive