The additional epoch might have called the random number generator at some place, thus yielding other results in the following folds.
You could try to initialize the model once before starting the training, copy the state_dict (using copy.deepcopy) and then reinitialize it for each fold instead of recreating the model for each fold.
I assume this should yield the same results.