Thank you @BramVanroy. Few things:


Subclass the PreTrainedModel - how can I do this as I assume it is not the same as below?
BertSequenceClassification =  BertForSequenceClassification.from_pretrained(‘bert-base-uncased’)


Use the save_pretrained: I will try the below:
model.save_pretrained(str)


Load_pretrained methods directly: I will try the below:
model.from_pretrained(str)