Yes, I applied argmax. It’s just generation requires for example a special starting token to be fed to the model and I could not find an example in the doc for generation without the .generate() function which only returns the tokens. And the first predicted token and the token generated after I fed BOS to the decoder are sometimes different.