Hello experienced ones,
When the training is progressing, I see the test accuracy does not change a lot and is almost steady. However, when I save the checkpoint and resume the iteration from the checkpoint the training show a jump in the test accuracy with a significant margin.
I wonder if you guys know what is going on and possibly provide an explanation for such a random behavior.
@ptrblck