This tutorial 5 explains how to store and load state_dicts and general checkpoints. Once you’ve loaded the model’s and optimizer’s state_dicts you could continue with your training as was you’ve done before.