Towards Data Science, Deep Learning, Machine Learning, Neural Networks, Naturallanguageprocessing.
the transformer architecture to understand the position of the word in a sentence, and not mess up the meaning by jumbling the words. After the word/input embedding and positional embedding is complete, the embeddings then flow into the most important part of the encoder which contains the two