NLP, ChatGPT, Deep Learning, Artificial Intelligence, Data Science.
shortcomings: They lose all notion of word order and syntactic structure, which can be critical for understanding. “John eats fish” and “fish eats John” would have the same representation. They suffer from high dimensionality and sparsity, as vocabularies can be very large. This requires