readme: ---
  license: mit
  tags:
  - generated_from_trainer
  model-index:
  - name: mlcovid19-classifier
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # mlcovid19-classifier
  
  This model is a fine-tuned version of [oscarwu/mlcovid19-classifier](https://huggingface.co/oscarwu/mlcovid19-classifier) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.2879
  - F1 Macro: 0.7978
  - F1 Misinformation: 0.9347
  - F1 Factual: 0.9423
  - F1 Other: 0.5166
  - Prec Macro: 0.8156
  - Prec Misinformation: 0.9277
  - Prec Factual: 0.9345
  - Prec Other: 0.5846
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 128
  - eval_batch_size: 128
  - seed: 42
  - gradient_accumulation_steps: 32
  - total_train_batch_size: 4096
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_steps: 2607
  - num_epochs: 400
  
  ### Training results
  
  | Training Loss | Epoch  | Step | Validation Loss | F1 Macro | F1 Misinformation | F1 Factual | F1 Other | Prec Macro | Prec Misinformation | Prec Factual | Prec Other |
  |:-------------:|:------:|:----:|:---------------:|:--------:|:-----------------:|:----------:|:--------:|:----------:|:-------------------:|:------------:|:----------:|
  | 0.4535        | 1.98   | 10   | 0.4122          | 0.6809   | 0.8906            | 0.8993     | 0.2529   | 0.7749     | 0.8433              | 0.9169       | 0.5646     |
  | 0.4445        | 3.98   | 20   | 0.4056          | 0.6844   | 0.8918            | 0.9004     | 0.2611   | 0.7706     | 0.8461              | 0.9171       | 0.5487     |
  | 0.4362        | 5.98   | 30   | 0.3966          | 0.6870   | 0.8930            | 0.9020     | 0.2658   | 0.7672     | 0.8490              | 0.9171       | 0.5356     |
  | 0.4229        | 7.98   | 40   | 0.3864          | 0.6885   | 0.8955            | 0.9055     | 0.2645   | 0.7652     | 0.8531              | 0.9179       | 0.5246     |
  | 0.4134        | 9.98   | 50   | 0.3774          | 0.6889   | 0.8983            | 0.9091     | 0.2594   | 0.7697     | 0.8573              | 0.9173       | 0.5345     |
  | 0.4004        | 11.98  | 60   | 0.3682          | 0.6907   | 0.8996            | 0.9111     | 0.2616   | 0.7763     | 0.8605              | 0.9148       | 0.5536     |
  | 0.3893        | 13.98  | 70   | 0.3583          | 0.6960   | 0.9014            | 0.9124     | 0.2740   | 0.7853     | 0.8629              | 0.9152       | 0.5778     |
  | 0.3853        | 15.98  | 80   | 0.3483          | 0.7036   | 0.9031            | 0.9157     | 0.2920   | 0.7749     | 0.8683              | 0.9172       | 0.5390     |
  | 0.369         | 17.98  | 90   | 0.3399          | 0.7011   | 0.9037            | 0.9167     | 0.2828   | 0.7775     | 0.8690              | 0.9159       | 0.5476     |
  | 0.36          | 19.98  | 100  | 0.3312          | 0.7102   | 0.9056            | 0.9194     | 0.3055   | 0.7836     | 0.8733              | 0.9167       | 0.5609     |
  | 0.3445        | 21.98  | 110  | 0.3237          | 0.7116   | 0.9065            | 0.9204     | 0.3078   | 0.7860     | 0.8749              | 0.9165       | 0.5667     |
  | 0.3406        | 23.98  | 120  | 0.3181          | 0.7058   | 0.9068            | 0.9212     | 0.2893   | 0.7880     | 0.8740              | 0.9162       | 0.5738     |
  | 0.3286        | 25.98  | 130  | 0.3094          | 0.7183   | 0.9099            | 0.9250     | 0.32     | 0.7932     | 0.8782              | 0.9216       | 0.5797     |
  | 0.3213        | 27.98  | 140  | 0.3049          | 0.7187   | 0.9111            | 0.9254     | 0.3196   | 0.7957     | 0.8800              | 0.9204       | 0.5867     |
  | 0.3111        | 29.98  | 150  | 0.3017          | 0.7219   | 0.9129            | 0.9264     | 0.3263   | 0.7983     | 0.8843              | 0.9178       | 0.5927     |
  | 0.3087        | 31.98  | 160  | 0.2970          | 0.7231   | 0.9132            | 0.9276     | 0.3287   | 0.7977     | 0.8850              | 0.9188       | 0.5893     |
  | 0.2992        | 33.98  | 170  | 0.2926          | 0.7243   | 0.9141            | 0.9293     | 0.3293   | 0.8003     | 0.8839              | 0.9235       | 0.5935     |
  | 0.2924        | 35.98  | 180  | 0.2892          | 0.7312   | 0.9150            | 0.9303     | 0.3482   | 0.7971     | 0.8889              | 0.9218       | 0.5806     |
  | 0.2878        | 37.98  | 190  | 0.2870          | 0.7356   | 0.9173            | 0.9324     | 0.3571   | 0.8027     | 0.8906              | 0.9246       | 0.5929     |
  | 0.2811        | 39.98  | 200  | 0.2844          | 0.7439   | 0.9188            | 0.9328     | 0.3801   | 0.8109     | 0.8954   