I don’t completely understand what



 Ammar_ul_hassan:

append my finetuned model in the pre-trained model


means.
Assuming you are storing the state_dict of the model, it would contain all trained parameters and buffers on the current use case. If you then fine-tune the model on another use case (e.g. numbers between 6 to 9) your model might “forget” the previously learned use case and the parameters might be updated to learn the currently trained use case. You wouldn’t be able to “append” this new model to the old one as it’s basically still the same model with another parameter set, so could you explain your use case a bit more, please?