Solved by albanD in post #2 
              
              
                Hi, 
Have you tried using module.flatten_parameters() on your RNN module to make sure the weights are nicely layed out in memory again?