Hi,
you can save the optimizer setting using: optimizer.state_dict()
here is an example for saving:
        states = {
            'epoch': epoch + 1,
            'arch': opt.arch,
            'state_dict': model.state_dict(),
            'optimizer': optimizer.state_dict(),
        }
        torch.save(states, save_file_path)

here is an example for loading the settings:
optimizer.load_state_dict(checkpoint['optimizer']

Best Regards,
Tal