@sgugger thank you so much, got it all working…now I have an issue for training time though. I froze all layers but the head and am trying to train using the script. Its working but giving me an estimated time of 8 hours! Is that normal?
(to do this, I configured my model to have 10 layers, added
for param in model.base_model.parameters():
    param.requires_grad = False

to freeze the layers and then saved the model. I loaded this model in the script)