Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
What are the different types of Transformer? Whilst there are now many different transformer architectures, most can be categorised into three main types. Encoder Architectures Encoder models aim to produce contextual embeddings that can be used for downstream tasks such as classification or named