Towards Data Science, Neural Networks, Deep Learning, Machine Learning, Naturallanguageprocessing.
blocks are stacked together to form the Transformer Network, and also talk about some networks based on Transformers such as BERT and GPT. References: Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all