You can change the learning rate using torch.optim.lr_scheduler or by
for param_group in optimizer.param_groups:
      param_group['lr'] = lr

Usually, I save the model after some epochs for pausing. I’d like to know if you have better way.