So if I understand right, the sentence that is too long will see some of its tokens deleted, without using these extra tokens to train the future model?
Does these tokens are randomly selected or if the max_lenght=100 then tokens > 100 will be deleted?
Thank you