readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: korean-aihub-learning-3
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # korean-aihub-learning-3
  
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 2.2854
  - Wer: 0.7921
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 0.0003
  - train_batch_size: 4
  - eval_batch_size: 8
  - seed: 42
  - gradient_accumulation_steps: 2
  - total_train_batch_size: 8
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_steps: 500
  - num_epochs: 100
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Wer    |
  |:-------------:|:-----:|:----:|:---------------:|:------:|
  | No log        | 0.99  | 35   | 45.5713         | 1.0    |
  | No log        | 1.99  | 70   | 24.4376         | 1.0    |
  | 35.4145       | 2.99  | 105  | 18.3030         | 1.0    |
  | 35.4145       | 3.99  | 140  | 12.6702         | 1.0    |
  | 35.4145       | 4.99  | 175  | 7.4939          | 1.0    |
  | 11.687        | 5.99  | 210  | 4.9592          | 1.0    |
  | 11.687        | 6.99  | 245  | 4.6777          | 1.0    |
  | 11.687        | 7.99  | 280  | 4.6597          | 1.0    |
  | 4.8003        | 8.99  | 315  | 4.6777          | 1.0    |
  | 4.8003        | 9.99  | 350  | 4.7003          | 1.0    |
  | 4.8003        | 10.99 | 385  | 4.6129          | 1.0    |
  | 4.6383        | 11.99 | 420  | 4.6209          | 1.0    |
  | 4.6383        | 12.99 | 455  | 4.6035          | 1.0    |
  | 4.6383        | 13.99 | 490  | 4.6166          | 1.0    |
  | 4.577         | 14.99 | 525  | 4.6026          | 1.0    |
  | 4.577         | 15.99 | 560  | 4.5337          | 1.0    |
  | 4.577         | 16.99 | 595  | 4.5284          | 1.0    |
  | 4.5124        | 17.99 | 630  | 4.5710          | 1.0    |
  | 4.5124        | 18.99 | 665  | 4.5223          | 1.0    |
  | 4.3818        | 19.99 | 700  | 4.4472          | 1.0    |
  | 4.3818        | 20.99 | 735  | 4.4272          | 0.9977 |
  | 4.3818        | 21.99 | 770  | 4.4160          | 0.9977 |
  | 4.2796        | 22.99 | 805  | 4.3741          | 0.9988 |
  | 4.2796        | 23.99 | 840  | 4.3087          | 1.0    |
  | 4.2796        | 24.99 | 875  | 4.2336          | 1.0    |
  | 4.0489        | 25.99 | 910  | 4.1352          | 0.9988 |
  | 4.0489        | 26.99 | 945  | 4.0669          | 1.0    |
  | 4.0489        | 27.99 | 980  | 3.8551          | 0.9988 |
  | 3.6122        | 28.99 | 1015 | 3.6699          | 0.9919 |
  | 3.6122        | 29.99 | 1050 | 3.4580          | 0.9781 |
  | 3.6122        | 30.99 | 1085 | 3.1899          | 0.9434 |
  | 2.8886        | 31.99 | 1120 | 3.0746          | 0.9550 |
  | 2.8886        | 32.99 | 1155 | 2.8143          | 0.9353 |
  | 2.8886        | 33.99 | 1190 | 2.7004          | 0.9122 |
  | 2.0277        | 34.99 | 1225 | 2.5284          | 0.9076 |
  | 2.0277        | 35.99 | 1260 | 2.4677          | 0.8972 |
  | 2.0277        | 36.99 | 1295 | 2.3426          | 0.8568 |
  | 1.2486        | 37.99 | 1330 | 2.2456          | 0.8822 |
  | 1.2486        | 38.99 | 1365 | 2.3250          | 0.9238 |
  | 0.7572        | 39.99 | 1400 | 2.2832          | 0.8557 |
  | 0.7572        | 40.99 | 1435 | 2.2671          | 0.8406 |
  | 0.7572        | 41.99 | 1470 | 2.3070          | 0.8857 |
  | 0.4768        | 42.99 | 1505 | 2.2138          | 0.8476 |
  | 0.4768        | 43.99 | 1540 | 2.2034          | 0.8799 |
  | 0.4768        | 44.99 | 1575 | 2.2215          | 0.8487 |
  | 0.3362        | 45.99 | 1610 | 2.3416          | 0.8834 |
  | 0.3362        | 46.99 | 1645 | 2.3452          | 0.8383 |
  | 0.3362        | 47.99 | 1680 | 2.2449          | 0.8360 |
  | 0.257         | 48.99 | 1715 | 2.2249          | 0.8199 |
  | 0.257         | 49.99 | 1750 | 2.3455          | 0.8106 |
  | 0.257         | 50.99 | 1785 | 2.2537          | 0.8233 |
  | 0.2116        | 51.99 | 1820 | 2.2501          | 0.8025 |
  | 0.2116        | 52.99 | 1855 | 2.3180          | 0.8649 |
  | 0.2116        | 53.99 | 1890 | 2.1855          | 0.8106 |
  | 0.1787        | 54.99 | 1925 | 2.2140          | 0.8014 |
  | 0.1787        | 55.99 | 1960 | 2.3140          | 0.8453 |
  | 0.1787        | 56.99 | 1995 | 2.2140          | 0.8025 |
  | 0.1498        | 57.99 | 2030 | 2.3381          | 0.8314 |
  | 0.1498        | 58.99 | 2065 | 2.2591          | 0.8256 |
  | 0.1372        | 59.99 | 2100 | 2.2538          | 0.7979 |
  | 0.1372        | 60.99 | 2135 | 2.2052          | 0.7933 |
  | 0.1372        | 61.99 | 2170 | 2.2370      