readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: bert-tiny-finetuned-legal-definitions-downstream-alt
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # bert-tiny-finetuned-legal-definitions-downstream-alt
  
  This model is a fine-tuned version of [muhtasham/bert-tiny-finetuned-legal-definitions](https://huggingface.co/muhtasham/bert-tiny-finetuned-legal-definitions) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.2298
  - Micro f1: 0.0
  - Macro f1: 0.0
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 4096
  - eval_batch_size: 1024
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 1000
  
  ### Training results
  
  | Training Loss | Epoch  | Step | Validation Loss | Micro f1 | Macro f1 |
  |:-------------:|:------:|:----:|:---------------:|:--------:|:--------:|
  | 0.6869        | 1.0    | 3    | 0.6836          | 0.1357   | 0.0837   |
  | 0.6832        | 2.0    | 6    | 0.6795          | 0.1402   | 0.0785   |
  | 0.6795        | 3.0    | 9    | 0.6755          | 0.1468   | 0.0748   |
  | 0.6758        | 4.0    | 12   | 0.6716          | 0.1504   | 0.0697   |
  | 0.6722        | 5.0    | 15   | 0.6677          | 0.1506   | 0.0627   |
  | 0.6686        | 6.0    | 18   | 0.6639          | 0.1528   | 0.0580   |
  | 0.6649        | 7.0    | 21   | 0.6601          | 0.1435   | 0.0506   |
  | 0.6615        | 8.0    | 24   | 0.6563          | 0.1300   | 0.0432   |
  | 0.658         | 9.0    | 27   | 0.6526          | 0.1049   | 0.0307   |
  | 0.6544        | 10.0   | 30   | 0.6490          | 0.0859   | 0.0242   |
  | 0.6511        | 11.0   | 33   | 0.6454          | 0.0610   | 0.0178   |
  | 0.6476        | 12.0   | 36   | 0.6418          | 0.0362   | 0.0110   |
  | 0.644         | 13.0   | 39   | 0.6383          | 0.0219   | 0.0074   |
  | 0.641         | 14.0   | 42   | 0.6349          | 0.0108   | 0.0042   |
  | 0.6376        | 15.0   | 45   | 0.6315          | 0.0057   | 0.0022   |
  | 0.6344        | 16.0   | 48   | 0.6282          | 0.0024   | 0.0010   |
  | 0.6311        | 17.0   | 51   | 0.6249          | 0.0012   | 0.0005   |
  | 0.6279        | 18.0   | 54   | 0.6217          | 0.0008   | 0.0003   |
  | 0.6248        | 19.0   | 57   | 0.6184          | 0.0      | 0.0      |
  | 0.6218        | 20.0   | 60   | 0.6153          | 0.0      | 0.0      |
  | 0.6185        | 21.0   | 63   | 0.6121          | 0.0      | 0.0      |
  | 0.6153        | 22.0   | 66   | 0.6089          | 0.0      | 0.0      |
  | 0.6123        | 23.0   | 69   | 0.6058          | 0.0      | 0.0      |
  | 0.6092        | 24.0   | 72   | 0.6027          | 0.0      | 0.0      |
  | 0.6062        | 25.0   | 75   | 0.5996          | 0.0      | 0.0      |
  | 0.6032        | 26.0   | 78   | 0.5965          | 0.0      | 0.0      |
  | 0.6001        | 27.0   | 81   | 0.5934          | 0.0      | 0.0      |
  | 0.597         | 28.0   | 84   | 0.5902          | 0.0      | 0.0      |
  | 0.594         | 29.0   | 87   | 0.5871          | 0.0      | 0.0      |
  | 0.5908        | 30.0   | 90   | 0.5840          | 0.0      | 0.0      |
  | 0.5877        | 31.0   | 93   | 0.5808          | 0.0      | 0.0      |
  | 0.5845        | 32.0   | 96   | 0.5777          | 0.0      | 0.0      |
  | 0.5814        | 33.0   | 99   | 0.5745          | 0.0      | 0.0      |
  | 0.5785        | 34.0   | 102  | 0.5714          | 0.0      | 0.0      |
  | 0.5753        | 35.0   | 105  | 0.5682          | 0.0      | 0.0      |
  | 0.5719        | 36.0   | 108  | 0.5650          | 0.0      | 0.0      |
  | 0.5688        | 37.0   | 111  | 0.5618          | 0.0      | 0.0      |
  | 0.5656        | 38.0   | 114  | 0.5586          | 0.0      | 0.0      |
  | 0.5626        | 39.0   | 117  | 0.5553          | 0.0      | 0.0      |
  | 0.5591        | 40.0   | 120  | 0.5521          | 0.0      | 0.0      |
  | 0.5561        | 41.0   | 123  | 0.5489          | 0.0      | 0.0      |
  | 0.5529        | 42.0   | 126  | 0.5456          | 0.0      | 0.0      |
  | 0.5494        | 43.0   | 129  | 0.5424          | 0.0      | 0.0      |
  | 0.5464        | 44.0   | 132  | 0.5391          | 0.0      | 0.0      |
  | 0.5432        | 45.0   | 135  | 0.5359          | 0.0      | 0.0      |
  | 0.5399        | 46.0   | 138  | 0.5326          | 0.0      | 0.0      |
  | 0.5364        | 47.0   | 141  | 0.5294          | 0.0      | 0.0      |
  | 0.5332        | 48.0   | 144  | 0.5261          | 0.0      | 0.0      |
  | 0.53          | 49.0   | 147  | 0.5229          | 0.0      | 0.0      |
  | 0.5268        | 50.0   | 150  | 0.5196          | 0.0      | 0