Hello @Jorgeutd,
Are you using the examples/ script? and are you passing the hyperparameter → 'predict_with_generate': True,

predict_with_generate ( bool , optional, defaults to False ):
Whether to use generate to calculate generative metrics (ROUGE, BLEU).`