Solved by ptrblck in post #2 
              
              
                It depends on your use case. 
If you need exactly the same parameters for the new model in order to recreate some experiment, I would save and reload the state_dict as this would probably be the easiest method. 
However, if you just want to train from scratch using a new model, you could just instan…