Thank you for your help!
If I have load_best_model_at_end activated when I train my model, whenever I use the
BertForMaskedLM.from_pretrained()
am I guaranteed to automatically recover my best checkpoint?