Ok, the problem seems to be known already.
By saving the model it saved it in eval() mode.
The outputs will be the same for the eval() mode.
Unfortunately I calculate the loss in model.train().
So my new question would be, if there is a way to continue training, without having a “kink” in the loss values?