I am using bigbird-pegasus model pretrained with bigpatent. So I think my loss is the probability of the test sequences.
I understand that having improved probability of the test sequences should lead to having improved ROUGE scores when generating. Isn’t it?