Transformers, Pytorch, Machine Learning, Deep Dives, Data Science.
input. During inference, there is not target : the model starts by outputting a token by attending to the output, and uses its own prediction to continue emitting tokens. This is why those models are often called auto-regressive models, as they use past predictions to predict to next one. The