readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: distilroberta-base-finetuned-wikitextepoch_150
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # distilroberta-base-finetuned-wikitextepoch_150
  
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.8929
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 150
  
  ### Training results
  
  | Training Loss | Epoch | Step   | Validation Loss |
  |:-------------:|:-----:|:------:|:---------------:|
  | 2.2428        | 1.0   | 1121   | 2.0500          |
  | 2.1209        | 2.0   | 2242   | 1.9996          |
  | 2.0665        | 3.0   | 3363   | 1.9501          |
  | 2.0179        | 4.0   | 4484   | 1.9311          |
  | 1.9759        | 5.0   | 5605   | 1.9255          |
  | 1.9089        | 6.0   | 6726   | 1.8805          |
  | 1.9143        | 7.0   | 7847   | 1.8715          |
  | 1.8744        | 8.0   | 8968   | 1.8671          |
  | 1.858         | 9.0   | 10089  | 1.8592          |
  | 1.8141        | 10.0  | 11210  | 1.8578          |
  | 1.7917        | 11.0  | 12331  | 1.8574          |
  | 1.7752        | 12.0  | 13452  | 1.8423          |
  | 1.7722        | 13.0  | 14573  | 1.8287          |
  | 1.7354        | 14.0  | 15694  | 1.8396          |
  | 1.7217        | 15.0  | 16815  | 1.8244          |
  | 1.6968        | 16.0  | 17936  | 1.8278          |
  | 1.659         | 17.0  | 19057  | 1.8412          |
  | 1.6442        | 18.0  | 20178  | 1.8328          |
  | 1.6441        | 19.0  | 21299  | 1.8460          |
  | 1.6267        | 20.0  | 22420  | 1.8343          |
  | 1.612         | 21.0  | 23541  | 1.8249          |
  | 1.5963        | 22.0  | 24662  | 1.8253          |
  | 1.6101        | 23.0  | 25783  | 1.7843          |
  | 1.5747        | 24.0  | 26904  | 1.8047          |
  | 1.5559        | 25.0  | 28025  | 1.8618          |
  | 1.5484        | 26.0  | 29146  | 1.8660          |
  | 1.5411        | 27.0  | 30267  | 1.8318          |
  | 1.5247        | 28.0  | 31388  | 1.8216          |
  | 1.5278        | 29.0  | 32509  | 1.8075          |
  | 1.4954        | 30.0  | 33630  | 1.8073          |
  | 1.4863        | 31.0  | 34751  | 1.7958          |
  | 1.4821        | 32.0  | 35872  | 1.8080          |
  | 1.4357        | 33.0  | 36993  | 1.8373          |
  | 1.4602        | 34.0  | 38114  | 1.8199          |
  | 1.447         | 35.0  | 39235  | 1.8325          |
  | 1.4292        | 36.0  | 40356  | 1.8075          |
  | 1.4174        | 37.0  | 41477  | 1.8168          |
  | 1.4103        | 38.0  | 42598  | 1.8095          |
  | 1.4168        | 39.0  | 43719  | 1.8233          |
  | 1.4005        | 40.0  | 44840  | 1.8388          |
  | 1.3799        | 41.0  | 45961  | 1.8235          |
  | 1.3657        | 42.0  | 47082  | 1.8298          |
  | 1.3559        | 43.0  | 48203  | 1.8165          |
  | 1.3723        | 44.0  | 49324  | 1.8059          |
  | 1.3535        | 45.0  | 50445  | 1.8451          |
  | 1.3533        | 46.0  | 51566  | 1.8458          |
  | 1.3469        | 47.0  | 52687  | 1.8237          |
  | 1.3247        | 48.0  | 53808  | 1.8264          |
  | 1.3142        | 49.0  | 54929  | 1.8209          |
  | 1.2958        | 50.0  | 56050  | 1.8244          |
  | 1.293         | 51.0  | 57171  | 1.8311          |
  | 1.2784        | 52.0  | 58292  | 1.8287          |
  | 1.2731        | 53.0  | 59413  | 1.8600          |
  | 1.2961        | 54.0  | 60534  | 1.8086          |
  | 1.2739        | 55.0  | 61655  | 1.8303          |
  | 1.2716        | 56.0  | 62776  | 1.8214          |
  | 1.2459        | 57.0  | 63897  | 1.8440          |
  | 1.2492        | 58.0  | 65018  | 1.8503          |
  | 1.2393        | 59.0  | 66139  | 1.8316          |
  | 1.2077        | 60.0  | 67260  | 1.8283          |
  | 1.2426        | 61.0  | 68381  | 1.8413          |
  | 1.2032        | 62.0  | 69502  | 1.8461          |
  | 1.2123        | 63.0  | 70623  | 1.8469          |
  | 1.2069        | 64.0  | 71744  | 1.8478          |
  | 1.198         | 65.0  | 72865  | 1.8479          |
  | 1.1972        | 66.0  | 73986  | 1.8516          |
  | 1.1885        | 67.0  | 75107  | 1.8341          |
  | 1.1784        | 68.0  | 76228  | 1.8322          |
  | 1.1866        | 69.0  | 77349  | 1.8559          |
  | 1.1648        | 70.0  | 78470  | 1.8758          |
  | 1.1595        | 71.0  | 79591  | 1.8684          |
  | 1.1661        | 72.0  | 80712  | 1.8553          |
  | 1.1478        | 73.0  |