Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
usually employed for autoregressive tasks, such as sequence generation. However, when using contextual embeddings to generate sequences, there are some additional considerations when compared to using an Encoder. An example of this is shown below. We can notice that, whilst the decoder produces a