 Evaluation Results Before fine-tuning, the English GPT-2 model went through a validation step just to see how the model fairs prior to training.  | valid loss | perplexity | |------------|------------| |   10.845   |  51313.62  |  The model was then trained afterwards for 5 epochs and the following are the results.  | epoch | train loss | valid loss | perplexity | total time | |-------|------------|------------|------------|------------| |   0   |    4.336   |    4.110   |    60.94   |    22:28   | |   1   |    3.598   |    3.543   |    34.58   |    23:27   | |   2   |    3.161   |    3.331   |    27.98   |    24:17   | |   3   |    2.974   |    3.265   |    26.18   |    25:03   | |   4   |    2.932   |    3.234   |    25.39   |    25:06   |  