I have a question about saving model.
I have 2 tasks which output is not the same.
The first one is a classifier.
The second one is a NER.
I would like to fine-tune a dataset via Roberta for task 1.
I want to save the weight of model, and just save the weight origin Roberta has.
And them use this weight to add down-stream layer and fine-tune second model.
Can model.save_state do that?
Or I should load all layer and trunct the layer I don’t need.