Could you try to create a small dummy dataset with just a few samples?
If the loading of the checkpoint is broken, the loss jump should also be visible using a random dataset as long as the model trains.