@sgugger Thank you for the reply, it worked perfectly!
One quick follow up question. If I have finetuned a model and saved it off just after training, what is the best way to load that model and evaluate it on a test set?