Should be fixed as soon as [Generation] Fix bug for manual decoder_input_ids + warning message by patrickvonplaten · Pull Request #9472 · huggingface/transformers · GitHub 16 is merged. Thanks a lot for reporting this issue and making the library better