@ptrblck I will try that; I think I am confused because I have been more accustomed to train the image; and I save latest checkpoint and best checkpoints:
checkpoint = {
            'epoch': epoch + 1,
            'valid_loss_min': valid_loss,
            'state_dict': model.state_dict(),
            'optimizer': optimizer.state_dict(),
        }

For NLP, are there any specific thing I should save on top of the things above ?