Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
paper; where the layer norm layers are situated after the attention blocks. Conclusion Hopefully this has provided an intuition on how transformers work, helped to break down some of the details in a somewhat digestible way and has acted as good starting point into demystifying modern transformer