Given that you have the pre-trained model, you can always use load() to load the state dictionary from pre-trained model file into your model. The link below is very detailed and answers what you need. https://pytorch.org/tutorials/beginner/saving_loading_models.html