Hello,
When (1) is done, you should save the state_dict of the model AND optimizer. So when you start (3) you load the pre-trained model and the optimizer to restore its state, as adviced here: Saving & Loading a General Checkpoint for Inference and/or Resuming Training 1.
Best regards,
Thomas