Thank you @lewtun for your reply. Actually I’m not sure about that. I could not find a source about this either. However, I checked the model in here 1, and I wonder how this could happen with pegasus or bart.