Thank you for the answer. If you notice in the blog post, the attention_mask feature is not included in the final dataset (the one after the preprocessing is done). Therefore, is it correct to assume that we do not pass the argument attention_mask in the model after all, even though we should?
Nevertheless, in the DataCollator class, we use the value -100 in the arrays that contain the labels of the input, to indicate what parts correspond to padding tokens. Is this something equivalent?
Thanks in advance.