Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
Encoder-decoder Architectures Originally, the transformer was presented as an architecture for machine translation and used both an encoder and decoder to accomplish this goal; using the encoder to create an intermediate representation, before using the decoder to translate to the desired output