Thank you for your input!
I thought of exchanging the entire head but what I’m struggling to understand s what exactly the process would need to be.
Say I load the model in pytorch directly, not through flair, and then switch out the last Linear() with a new one, would I just be able to train that model properly?
Don’t I need the optimzer as well in order to continue training?
Or is my understanding incorrect here and I can theoretically just load up any model and train it as if it was from scratch? (Now that I’m typing this out, I actually see no reason why that shouldn’t work )