The loss in the tutorial corresponds to the loss value when it’s saved. It’s not mandatory to save it when you want to resume training, but it can be useful to have (if you want to check consistency for example…)
With step LR, you can give the last epoch as an argument when constructing it. This will update the scheduling accordingly, but you need to save the last step with the checkpoint.