Thanks, I figured what the issue was. We were pickling our models.
I had to load the model and write it out to a directory using bert_model.save_pretrained(save_dir) and then load it in v3 using BertModel.from_pretrained(save_dir)