Transformers, Pytorch, Machine Learning, Deep Dives, Data Science.
excluding certain parts of the inputs when doing attention. During training, we consider batches of inputs and targets, wherein each instance may have a variable length. Consider the following example where we batch 4 words : banana, watermelon, pear, blueberry. In order to process them as a single