I wanted to test if the training on the POS task results in better scores compared to using just the pain BERT base.
So my question is: How do I extract the “base” part from a trained model and add a new head?