Solved by tom in post #2 
              
              
                Well, so restoring the state and continuing is the equivalent of doing a single larger training run. 
What happens is that during the first few steps, the statistics gathered by the optimizer are still “rubbish”, and so you will take steps of more or less not terribly controlled size (the could be m…