readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  metrics:
  - f1
  model-index:
  - name: evjvqa_mt5_vit_16
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # evjvqa_mt5_vit_16
  
  This model is a fine-tuned version of [google/mt5-base](https://huggingface.co/google/mt5-base) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.2997
  - F1: 0.4194
  - Bleu4: 0.3783
  - Mean Pred Len: 14.85
  - Mean Label Len: 15.25
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 40
  - eval_batch_size: 40
  - seed: 42
  - gradient_accumulation_steps: 2
  - total_train_batch_size: 80
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_ratio: 0.2
  - num_epochs: 10
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | F1     | Bleu4  | Mean Pred Len | Mean Label Len |
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:-------------:|:--------------:|
  | 15.7375       | 0.07  | 20   | 9.6637          | 0.0771 | 0.0567 | 10.75         | 15.25          |
  | 15.7459       | 0.15  | 40   | 10.0761         | 0.0784 | 0.0754 | 11.5          | 15.25          |
  | 15.456        | 0.22  | 60   | 9.5077          | 0.0574 | 0.0595 | 11.35         | 15.25          |
  | 15.3725       | 0.3   | 80   | 9.5230          | 0.0589 | 0.0436 | 11.45         | 15.25          |
  | 14.9377       | 0.37  | 100  | 8.6082          | 0.079  | 0.0725 | 12.2          | 15.25          |
  | 14.5629       | 0.45  | 120  | 9.3522          | 0.0851 | 0.0704 | 12.35         | 15.25          |
  | 14.2505       | 0.52  | 140  | 8.0656          | 0.0666 | 0.0473 | 11.85         | 15.25          |
  | 13.4648       | 0.6   | 160  | 7.5456          | 0.0783 | 0.054  | 10.4          | 15.25          |
  | 13.055        | 0.67  | 180  | 7.0022          | 0.0607 | 0.0529 | 10.2          | 15.25          |
  | 12.2861       | 0.75  | 200  | 6.6263          | 0.0704 | 0.0677 | 10.4          | 15.25          |
  | 11.8459       | 0.82  | 220  | 6.1817          | 0.0849 | 0.0802 | 11.15         | 15.25          |
  | 10.9808       | 0.9   | 240  | 5.6607          | 0.0779 | 0.053  | 11.65         | 15.25          |
  | 10.0039       | 0.97  | 260  | 5.3278          | 0.0867 | 0.0619 | 10.55         | 15.25          |
  | 8.819         | 1.05  | 280  | 4.5316          | 0.1154 | 0.1346 | 9.45          | 15.25          |
  | 7.5032        | 1.12  | 300  | 3.7815          | 0.1355 | 0.1159 | 9.75          | 15.25          |
  | 6.1347        | 1.2   | 320  | 3.0172          | 0.1807 | 0.1546 | 9.85          | 15.25          |
  | 4.8126        | 1.27  | 340  | 2.6729          | 0.2177 | 0.1978 | 9.35          | 15.25          |
  | 4.1824        | 1.35  | 360  | 2.3100          | 0.3017 | 0.3567 | 11.3          | 15.25          |
  | 3.6456        | 1.42  | 380  | 2.2327          | 0.3029 | 0.3605 | 11.4          | 15.25          |
  | 3.3865        | 1.5   | 400  | 2.0704          | 0.316  | 0.3167 | 13.15         | 15.25          |
  | 3.2078        | 1.57  | 420  | 2.0376          | 0.3027 | 0.2856 | 13.5          | 15.25          |
  | 3.0357        | 1.65  | 440  | 1.9508          | 0.3207 | 0.3404 | 13.1          | 15.25          |
  | 2.9388        | 1.72  | 460  | 1.9042          | 0.3872 | 0.3665 | 13.5          | 15.25          |
  | 2.7807        | 1.8   | 480  | 1.8595          | 0.3954 | 0.3692 | 13.65         | 15.25          |
  | 2.7234        | 1.87  | 500  | 1.8956          | 0.3871 | 0.3484 | 14.2          | 15.25          |
  | 2.6417        | 1.95  | 520  | 1.7809          | 0.4406 | 0.3592 | 15.85         | 15.25          |
  | 2.5189        | 2.02  | 540  | 1.7255          | 0.4242 | 0.3844 | 14.8          | 15.25          |
  | 2.4075        | 2.1   | 560  | 1.7226          | 0.4378 | 0.4022 | 14.55         | 15.25          |
  | 2.3158        | 2.17  | 580  | 1.6749          | 0.46   | 0.4313 | 14.7          | 15.25          |
  | 2.3145        | 2.25  | 600  | 1.6850          | 0.4229 | 0.3525 | 15.75         | 15.25          |
  | 2.2615        | 2.32  | 620  | 1.6651          | 0.4618 | 0.3666 | 16.65         | 15.25          |
  | 2.1983        | 2.4   | 640  | 1.6409          | 0.4101 | 0.3297 | 15.1          | 15.25          |
  | 2.1365        | 2.47  | 660  | 1.6350          | 0.4317 | 0.3728 | 15.4          | 15.25          |
  | 2.1286        | 2.55  | 680  | 1.6045          | 0.389  | 0.3352 | 14.95         | 15.25          |
  | 2.1301        | 2.62  | 700  | 1.5884          | 0.4391 | 0.3679 | 15.55         | 15.25          |
  | 2.1368        | 2.7   | 720  | 1.5702          | 