Transformers, Pytorch, Machine Learning, Deep Dives, Data Science.
wanted this tutorial to show you the caveats when writing a Transformer : padding and masking are maybe the parts requiring the most attention (pun unintended) as they will define the good performance of the model during inference. In the following articles, we will look at how to create your own