Solved by tom in post #2 
              
              
                Apparently the number parameters known to the optimizer changed somehow. 
Note that this is from loading the optimizer’s state dict, not the model. 
Best regards 
Thomas