Generally you could try to retrain more parameters the more data you have and especially if it comes from another domain.
If you are dealing with a small dataset, training too many parameters might yield to overfitting.
Unfortunately, my best advice is that you would have to try it out and see what is working best for your use case.