Thanks for answer @ptrblck! Yes, padding is the only difference in this configuration. I am using huggingface transformers library and noticed that the amount of padding actually changes slightly loss value due to dropout. Anyway, I will try to prepare full example using some public dataset (I can’t share company’s data) and reach out to you.