Yes, it continues to the next epoch until it hits a better accuracy. If you use the same filename (here ‘best_model.pt’) it will replace the prior one. If you add a prefix ‘epoch_5_best_model.pt’ you will end up with a list of .pt files at the end of your run.
Personally I prefer keeping them all in case of overfitting.