Solved by Kaustubh_Kulkarni in post #6 
              
              
                Hey @ptrblck ! A follow up to this, it was a really silly mistake! In the model definition, I had 2 LSTM layers. For the first, I mentioned batch_first=True but for the second, I had forgotten. I have had this code for months and never thought to re write the model definition. Here is the corrected …