Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
Aside from this, the overall generation process is very similar to using a decoder only architecture. We can visualise an encoder-decoder architecture as seen in the figure below. Here, to simplify the figure, I chose to depict the post-layer norm variant of the transformer as seen in the original