Data Science, Machine Learning, NLP, Transformers, Word Embeddings.
embeddings like ELMo. But unlike ELMo Transformers do not use RNN, they do not require to process words in sentence sequentially one-by-one. All words in the sentence are processed in parallel, this approach speeds up processing and solves vanishing gradient problem. Transformers use the attention