This should be param.requires_grad = False. But I don’t see how freezing would help OP? Can you clarify that?
@noskid The best approach is to simply always finetune on the WHOLE dataset (old+new, preferably shuffled) so that the model is not biased on any specific subset.