readme: ---
  tags:
  - generated_from_trainer
  model-index:
  - name: improved_4bars-mdl
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # improved_4bars-mdl
  
  This model is a fine-tuned version of [JammyMachina/improved_4bars-mdl](https://huggingface.co/JammyMachina/improved_4bars-mdl) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.8519
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 21
  - eval_batch_size: 24
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 5
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss |
  |:-------------:|:-----:|:-----:|:---------------:|
  | 0.2574        | 0.1   | 1024  | 0.7889          |
  | 0.2633        | 0.21  | 2048  | 0.7802          |
  | 0.2635        | 0.31  | 3072  | 0.7877          |
  | 0.2639        | 0.41  | 4096  | 0.7751          |
  | 0.2625        | 0.52  | 5120  | 0.7836          |
  | 0.2609        | 0.62  | 6144  | 0.7758          |
  | 0.2597        | 0.73  | 7168  | 0.7923          |
  | 0.2612        | 0.83  | 8192  | 0.8000          |
  | 0.2612        | 0.93  | 9216  | 0.7935          |
  | 0.2554        | 1.04  | 10240 | 0.7943          |
  | 0.2524        | 1.14  | 11264 | 0.8015          |
  | 0.2504        | 1.24  | 12288 | 0.7962          |
  | 0.2524        | 1.35  | 13312 | 0.8086          |
  | 0.2521        | 1.45  | 14336 | 0.8062          |
  | 0.2503        | 1.55  | 15360 | 0.7998          |
  | 0.2523        | 1.66  | 16384 | 0.8098          |
  | 0.251         | 1.76  | 17408 | 0.8213          |
  | 0.2509        | 1.86  | 18432 | 0.8138          |
  | 0.2533        | 1.97  | 19456 | 0.8182          |
  | 0.245         | 2.07  | 20480 | 0.8290          |
  | 0.2432        | 2.18  | 21504 | 0.8328          |
  | 0.2435        | 2.28  | 22528 | 0.8187          |
  | 0.2423        | 2.38  | 23552 | 0.8238          |
  | 0.2443        | 2.49  | 24576 | 0.8249          |
  | 0.2431        | 2.59  | 25600 | 0.8253          |
  | 0.2432        | 2.69  | 26624 | 0.8269          |
  | 0.2421        | 2.8   | 27648 | 0.8282          |
  | 0.2421        | 2.9   | 28672 | 0.8268          |
  | 0.243         | 3.0   | 29696 | 0.8345          |
  | 0.2367        | 3.11  | 30720 | 0.8424          |
  | 0.237         | 3.21  | 31744 | 0.8374          |
  | 0.2351        | 3.32  | 32768 | 0.8431          |
  | 0.2374        | 3.42  | 33792 | 0.8425          |
  | 0.2355        | 3.52  | 34816 | 0.8352          |
  | 0.2373        | 3.63  | 35840 | 0.8452          |
  | 0.2356        | 3.73  | 36864 | 0.8383          |
  | 0.2343        | 3.83  | 37888 | 0.8444          |
  | 0.2348        | 3.94  | 38912 | 0.8428          |
  | 0.2349        | 4.04  | 39936 | 0.8480          |
  | 0.2327        | 4.14  | 40960 | 0.8482          |
  | 0.2337        | 4.25  | 41984 | 0.8510          |
  | 0.2288        | 4.35  | 43008 | 0.8499          |
  | 0.2299        | 4.45  | 44032 | 0.8522          |
  | 0.2277        | 4.56  | 45056 | 0.8526          |
  | 0.2301        | 4.66  | 46080 | 0.8518          |
  | 0.2312        | 4.77  | 47104 | 0.8511          |
  | 0.2284        | 4.87  | 48128 | 0.8507          |
  | 0.2294        | 4.97  | 49152 | 0.8519          |
  
  
  ### Framework versions
  
  - Transformers 4.26.0.dev0
  - Pytorch 1.13.1+cu116
  - Datasets 2.7.1
  - Tokenizers 0.13.2
  