Your error basically is a mismatch of the final layer which is the classifier part:
vblagoje/bert-english-uncased-finetuned-pos - this is already finetune weights for 17 classes
bert-base-uncased - you need to use this where isn’t finetuned for anything yet, so this is what you want to use for just fine tuning the 2 classes you have