Got it, I was  surprised though for instance here, which is basically the exact problem setup minus the first embedding layer, they use NLLLoss, which as for me fails with the sam error. I’m looking at all the dimensions and they seem the same, so I will keep debugging. Thanks
https://pytorch.org/tutorials/beginner/nlp/sequence_models_tutorial.html 8