readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  datasets:
  - common_voice
  model-index:
  - name: wav2vec2-xls-r-300m-ar-12
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # wav2vec2-xls-r-300m-ar-12
  
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
  It achieves the following results on the evaluation set:
  - Loss: 77.9014
  - Wer: 0.1633
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 0.0003
  - train_batch_size: 64
  - eval_batch_size: 16
  - seed: 42
  - gradient_accumulation_steps: 4
  - total_train_batch_size: 256
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_steps: 500
  - num_epochs: 200
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Wer    |
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
  | 16832.9559    | 1.0   | 85    | 1596.5383       | 1.0    |
  | 4748.8934     | 2.0   | 170   | 698.8426        | 1.0    |
  | 2939.1952     | 3.0   | 255   | 633.2770        | 1.0    |
  | 2833.7857     | 4.0   | 340   | 615.9734        | 1.0    |
  | 2778.75       | 5.0   | 425   | 609.7852        | 1.0    |
  | 2603.4421     | 6.0   | 510   | 435.0911        | 0.9998 |
  | 1420.6594     | 7.0   | 595   | 165.1980        | 0.7542 |
  | 811.7357      | 8.0   | 680   | 117.7532        | 0.5570 |
  | 582.7924      | 9.0   | 765   | 93.8724         | 0.4447 |
  | 469.1885      | 10.0  | 850   | 87.4084         | 0.3961 |
  | 399.7348      | 11.0  | 935   | 78.7740         | 0.3562 |
  | 348.0169      | 12.0  | 1020  | 72.9545         | 0.3278 |
  | 314.0225      | 13.0  | 1105  | 70.8449         | 0.3149 |
  | 281.4823      | 14.0  | 1190  | 66.1416         | 0.3013 |
  | 263.0267      | 15.0  | 1275  | 66.6624         | 0.2761 |
  | 238.7656      | 16.0  | 1360  | 66.3659         | 0.2742 |
  | 227.9712      | 17.0  | 1445  | 65.1213         | 0.2616 |
  | 209.4785      | 18.0  | 1530  | 66.3502         | 0.2600 |
  | 198.6275      | 19.0  | 1615  | 66.7867         | 0.2589 |
  | 189.7333      | 20.0  | 1700  | 65.1457         | 0.2499 |
  | 183.3984      | 21.0  | 1785  | 68.7480         | 0.2534 |
  | 174.6036      | 22.0  | 1870  | 67.8124         | 0.2480 |
  | 167.1744      | 23.0  | 1955  | 70.3643         | 0.2438 |
  | 160.6194      | 24.0  | 2040  | 68.3434         | 0.2387 |
  | 154.096       | 25.0  | 2125  | 69.3449         | 0.2391 |
  | 148.2008      | 26.0  | 2210  | 66.6332         | 0.2359 |
  | 143.9339      | 27.0  | 2295  | 67.2253         | 0.2292 |
  | 143.2862      | 28.0  | 2380  | 68.5232         | 0.2299 |
  | 136.5192      | 29.0  | 2465  | 71.3180         | 0.2286 |
  | 138.1667      | 30.0  | 2550  | 68.1166         | 0.2241 |
  | 129.6961      | 31.0  | 2635  | 69.9885         | 0.2270 |
  | 125.0034      | 32.0  | 2720  | 68.5696         | 0.2288 |
  | 122.382       | 33.0  | 2805  | 69.9053         | 0.2237 |
  | 121.4687      | 34.0  | 2890  | 72.5378         | 0.2325 |
  | 121.637       | 35.0  | 2975  | 74.0948         | 0.2302 |
  | 114.8182      | 36.0  | 3060  | 71.6004         | 0.2236 |
  | 114.9692      | 37.0  | 3145  | 73.0708         | 0.2215 |
  | 111.2695      | 38.0  | 3230  | 70.1939         | 0.2172 |
  | 109.1332      | 39.0  | 3315  | 73.6910         | 0.2216 |
  | 109.5747      | 40.0  | 3400  | 73.0911         | 0.2192 |
  | 112.0337      | 41.0  | 3485  | 72.5238         | 0.2285 |
  | 102.5452      | 42.0  | 3570  | 73.1730         | 0.2156 |
  | 104.4951      | 43.0  | 3655  | 70.9824         | 0.2116 |
  | 100.2483      | 44.0  | 3740  | 77.4810         | 0.2141 |
  | 100.7275      | 45.0  | 3825  | 70.5330         | 0.2131 |
  | 97.4453       | 46.0  | 3910  | 69.3713         | 0.2117 |
  | 97.4768       | 47.0  | 3995  | 78.6786         | 0.2150 |
  | 97.9564       | 48.0  | 4080  | 74.7395         | 0.2080 |
  | 95.7626       | 49.0  | 4165  | 73.5510         | 0.2165 |
  | 94.4995       | 50.0  | 4250  | 71.3337         | 0.2152 |
  | 92.4394       | 51.0  | 4335  | 74.3506         | 0.2091 |
  | 89.1442       | 52.0  | 4420  | 71.3629         | 0.2076 |
  | 89.8932       | 53.0  | 4505  | 70.2986         | 0.2119 |
  | 88.6913       | 54.0  | 4590  | 71.3645         | 0.2077 |
  | 91.1411       | 55.0  | 4675  | 74.9795         | 0.2166 |
  | 87.5678       | 56.0  | 4760  | 77.4106         | 0.2081 |
  | 83.0826       | 57.0  | 4845  | 75.1502         | 0.2099 |
  | 83.7437       | 58.0  | 4930  | 74.9253         | 0.2071 |
  | 85.8112       | 59.0  | 5015  | 70.0373         | 0.2067 |
  | 81.7675       | 60.0  | 5100  | 76.5425         | 0.2156 |
  |