readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: finetuned-marktextepoch-n800
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # finetuned-marktextepoch-n800
  
  This model is a fine-tuned version of [leokai/finetuned-marktextepoch-n600](https://huggingface.co/leokai/finetuned-marktextepoch-n600) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 2.8433
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 200
  
  ### Training results
  
  | Training Loss | Epoch | Step   | Validation Loss |
  |:-------------:|:-----:|:------:|:---------------:|
  | 0.287         | 1.0   | 1606   | 2.8473          |
  | 0.2913        | 2.0   | 3212   | 2.8147          |
  | 0.2865        | 3.0   | 4818   | 2.8809          |
  | 0.2947        | 4.0   | 6424   | 2.8510          |
  | 0.2988        | 5.0   | 8030   | 2.8883          |
  | 0.3109        | 6.0   | 9636   | 2.9016          |
  | 0.309         | 7.0   | 11242  | 2.8869          |
  | 0.301         | 8.0   | 12848  | 2.9201          |
  | 0.303         | 9.0   | 14454  | 2.8902          |
  | 0.3156        | 10.0  | 16060  | 2.8888          |
  | 0.3132        | 11.0  | 17666  | 2.8777          |
  | 0.3089        | 12.0  | 19272  | 2.9429          |
  | 0.3146        | 13.0  | 20878  | 2.9131          |
  | 0.3297        | 14.0  | 22484  | 2.8983          |
  | 0.3214        | 15.0  | 24090  | 2.9321          |
  | 0.3095        | 16.0  | 25696  | 2.9436          |
  | 0.3171        | 17.0  | 27302  | 2.9163          |
  | 0.308         | 18.0  | 28908  | 2.9545          |
  | 0.3174        | 19.0  | 30514  | 2.9161          |
  | 0.3163        | 20.0  | 32120  | 2.9081          |
  | 0.3191        | 21.0  | 33726  | 2.9465          |
  | 0.3254        | 22.0  | 35332  | 2.9404          |
  | 0.3168        | 23.0  | 36938  | 2.9054          |
  | 0.33          | 24.0  | 38544  | 2.9274          |
  | 0.3115        | 25.0  | 40150  | 2.9277          |
  | 0.3125        | 26.0  | 41756  | 2.9627          |
  | 0.3246        | 27.0  | 43362  | 2.9583          |
  | 0.3133        | 28.0  | 44968  | 2.9433          |
  | 0.3221        | 29.0  | 46574  | 2.9747          |
  | 0.3185        | 30.0  | 48180  | 2.9793          |
  | 0.3123        | 31.0  | 49786  | 2.9170          |
  | 0.3169        | 32.0  | 51392  | 2.9711          |
  | 0.3175        | 33.0  | 52998  | 2.9457          |
  | 0.3253        | 34.0  | 54604  | 2.9518          |
  | 0.3163        | 35.0  | 56210  | 2.9218          |
  | 0.3113        | 36.0  | 57816  | 2.9524          |
  | 0.3208        | 37.0  | 59422  | 2.9570          |
  | 0.3197        | 38.0  | 61028  | 2.9439          |
  | 0.3213        | 39.0  | 62634  | 2.9416          |
  | 0.3259        | 40.0  | 64240  | 2.9884          |
  | 0.3216        | 41.0  | 65846  | 2.9641          |
  | 0.3154        | 42.0  | 67452  | 2.9797          |
  | 0.3258        | 43.0  | 69058  | 2.9813          |
  | 0.3236        | 44.0  | 70664  | 2.9700          |
  | 0.3134        | 45.0  | 72270  | 2.9881          |
  | 0.3219        | 46.0  | 73876  | 2.9982          |
  | 0.3243        | 47.0  | 75482  | 2.9702          |
  | 0.3246        | 48.0  | 77088  | 2.9706          |
  | 0.3245        | 49.0  | 78694  | 2.9965          |
  | 0.3124        | 50.0  | 80300  | 2.9893          |
  | 0.3172        | 51.0  | 81906  | 2.9859          |
  | 0.3118        | 52.0  | 83512  | 2.9707          |
  | 0.3187        | 53.0  | 85118  | 2.9771          |
  | 0.3256        | 54.0  | 86724  | 2.9827          |
  | 0.3222        | 55.0  | 88330  | 2.9776          |
  | 0.3212        | 56.0  | 89936  | 2.9607          |
  | 0.3215        | 57.0  | 91542  | 2.9664          |
  | 0.3266        | 58.0  | 93148  | 2.9638          |
  | 0.3209        | 59.0  | 94754  | 2.9842          |
  | 0.333         | 60.0  | 96360  | 3.0053          |
  | 0.3202        | 61.0  | 97966  | 2.9833          |
  | 0.3155        | 62.0  | 99572  | 2.9952          |
  | 0.32          | 63.0  | 101178 | 2.9737          |
  | 0.3291        | 64.0  | 102784 | 2.9804          |
  | 0.3259        | 65.0  | 104390 | 2.9767          |
  | 0.32          | 66.0  | 105996 | 2.9610          |
  | 0.3208        | 67.0  | 107602 | 3.0111          |
  | 0.3277        | 68.0  | 109208 | 2.9588          |
  | 0.337         | 69.0  | 110814 | 2.9920          |
  | 0.3296        | 70.0  | 112420 | 2.9466          |
  | 0.3197        | 71.0  | 114026 | 2.9619          |
  | 0.323         | 72.0  | 115632 | 2.9733          |
  | 0.3247        | 73.0  | 1