readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: finetuned-marktextepoch-n200
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # finetuned-marktextepoch-n200
  
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 2.0880
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 200
  
  ### Training results
  
  | Training Loss | Epoch | Step   | Validation Loss |
  |:-------------:|:-----:|:------:|:---------------:|
  | 2.5742        | 1.0   | 1606   | 2.4071          |
  | 2.4441        | 2.0   | 3212   | 2.2715          |
  | 2.3699        | 3.0   | 4818   | 2.2896          |
  | 2.3074        | 4.0   | 6424   | 2.2295          |
  | 2.2667        | 5.0   | 8030   | 2.2147          |
  | 2.2376        | 6.0   | 9636   | 2.1886          |
  | 2.2161        | 7.0   | 11242  | 2.1816          |
  | 2.1611        | 8.0   | 12848  | 2.1690          |
  | 2.1418        | 9.0   | 14454  | 2.1541          |
  | 2.1198        | 10.0  | 16060  | 2.1355          |
  | 2.1033        | 11.0  | 17666  | 2.1132          |
  | 2.0738        | 12.0  | 19272  | 2.1441          |
  | 2.0581        | 13.0  | 20878  | 2.1068          |
  | 2.0555        | 14.0  | 22484  | 2.1035          |
  | 2.0375        | 15.0  | 24090  | 2.1000          |
  | 2.0071        | 16.0  | 25696  | 2.1084          |
  | 1.9942        | 17.0  | 27302  | 2.0711          |
  | 1.9554        | 18.0  | 28908  | 2.0978          |
  | 1.9469        | 19.0  | 30514  | 2.0705          |
  | 1.9414        | 20.0  | 32120  | 2.0597          |
  | 1.9331        | 21.0  | 33726  | 2.0782          |
  | 1.9132        | 22.0  | 35332  | 2.0622          |
  | 1.9003        | 23.0  | 36938  | 2.0426          |
  | 1.9019        | 24.0  | 38544  | 2.0562          |
  | 1.8733        | 25.0  | 40150  | 2.0419          |
  | 1.8556        | 26.0  | 41756  | 2.0572          |
  | 1.8399        | 27.0  | 43362  | 2.0453          |
  | 1.8332        | 28.0  | 44968  | 2.0517          |
  | 1.8296        | 29.0  | 46574  | 2.0580          |
  | 1.788         | 30.0  | 48180  | 2.0454          |
  | 1.7944        | 31.0  | 49786  | 2.0193          |
  | 1.7716        | 32.0  | 51392  | 2.0595          |
  | 1.7799        | 33.0  | 52998  | 2.0379          |
  | 1.7633        | 34.0  | 54604  | 2.0392          |
  | 1.7477        | 35.0  | 56210  | 2.0122          |
  | 1.7407        | 36.0  | 57816  | 2.0293          |
  | 1.7163        | 37.0  | 59422  | 2.0339          |
  | 1.72          | 38.0  | 61028  | 1.9987          |
  | 1.729         | 39.0  | 62634  | 2.0135          |
  | 1.709         | 40.0  | 64240  | 2.0455          |
  | 1.7019        | 41.0  | 65846  | 2.0206          |
  | 1.6958        | 42.0  | 67452  | 2.0408          |
  | 1.6789        | 43.0  | 69058  | 2.0470          |
  | 1.6907        | 44.0  | 70664  | 2.0280          |
  | 1.6531        | 45.0  | 72270  | 2.0514          |
  | 1.6563        | 46.0  | 73876  | 2.0428          |
  | 1.6364        | 47.0  | 75482  | 2.0305          |
  | 1.6534        | 48.0  | 77088  | 2.0200          |
  | 1.6312        | 49.0  | 78694  | 2.0444          |
  | 1.6092        | 50.0  | 80300  | 2.0154          |
  | 1.5998        | 51.0  | 81906  | 2.0249          |
  | 1.5808        | 52.0  | 83512  | 2.0235          |
  | 1.5945        | 53.0  | 85118  | 2.0286          |
  | 1.6004        | 54.0  | 86724  | 2.0288          |
  | 1.5802        | 55.0  | 88330  | 2.0346          |
  | 1.5665        | 56.0  | 89936  | 2.0120          |
  | 1.5723        | 57.0  | 91542  | 2.0257          |
  | 1.5553        | 58.0  | 93148  | 2.0146          |
  | 1.5445        | 59.0  | 94754  | 2.0333          |
  | 1.5669        | 60.0  | 96360  | 2.0325          |
  | 1.5318        | 61.0  | 97966  | 2.0250          |
  | 1.5117        | 62.0  | 99572  | 2.0343          |
  | 1.5248        | 63.0  | 101178 | 2.0183          |
  | 1.5149        | 64.0  | 102784 | 2.0422          |
  | 1.5087        | 65.0  | 104390 | 2.0236          |
  | 1.5087        | 66.0  | 105996 | 2.0275          |
  | 1.4938        | 67.0  | 107602 | 2.0384          |
  | 1.5008        | 68.0  | 109208 | 2.0167          |
  | 1.4871        | 69.0  | 110814 | 2.0456          |
  | 1.4931        | 70.0  | 112420 | 2.0083          |
  | 1.467         | 71.0  | 114026 | 2.0313          |
  | 1.4519        | 72.0  | 115632 | 2.0254          |
  | 1.448         | 73.0  | 117238 | 2.0289          |
  | 1.4475