readme: ---
  tags:
  - automatic-speech-recognition
  - gary109/AI_Light_Dance
  - generated_from_trainer
  datasets:
  - ai_light_dance
  model-index:
  - name: ai-light-dance_drums_ft_pretrain_wav2vec2-base
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # ai-light-dance_drums_ft_pretrain_wav2vec2-base
  
  This model is a fine-tuned version of [gary109/ai-light-dance_drums_ft_pretrain_wav2vec2-base](https://huggingface.co/gary109/ai-light-dance_drums_ft_pretrain_wav2vec2-base) on the GARY109/AI_LIGHT_DANCE - ONSET-DRUMS dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.8991
  - Wer: 0.6046
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 0.0004
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - gradient_accumulation_steps: 8
  - total_train_batch_size: 64
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_steps: 20
  - num_epochs: 200.0
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Wer    |
  |:-------------:|:-----:|:----:|:---------------:|:------:|
  | No log        | 0.9   | 8    | 2.0434          | 0.6226 |
  | 0.4739        | 1.9   | 16   | 2.1024          | 0.6247 |
  | 0.4693        | 2.9   | 24   | 1.9824          | 0.6211 |
  | 0.5139        | 3.9   | 32   | 2.2962          | 0.6429 |
  | 0.5081        | 4.9   | 40   | 2.2201          | 0.6292 |
  | 0.5081        | 5.9   | 48   | 2.1399          | 0.6208 |
  | 0.5785        | 6.9   | 56   | 2.1451          | 0.6417 |
  | 0.533         | 7.9   | 64   | 2.1184          | 0.6330 |
  | 0.5141        | 8.9   | 72   | 2.0230          | 0.6342 |
  | 0.4971        | 9.9   | 80   | 2.2137          | 0.6381 |
  | 0.4971        | 10.9  | 88   | 2.1159          | 0.6253 |
  | 0.5645        | 11.9  | 96   | 2.0966          | 0.6247 |
  | 0.4932        | 12.9  | 104  | 1.9249          | 0.6223 |
  | 0.4918        | 13.9  | 112  | 2.0445          | 0.6235 |
  | 0.5053        | 14.9  | 120  | 2.1317          | 0.6304 |
  | 0.5053        | 15.9  | 128  | 2.0723          | 0.6256 |
  | 0.5565        | 16.9  | 136  | 2.1390          | 0.6402 |
  | 0.4819        | 17.9  | 144  | 1.9556          | 0.6321 |
  | 0.5131        | 18.9  | 152  | 1.9886          | 0.6333 |
  | 0.4798        | 19.9  | 160  | 1.9700          | 0.6259 |
  | 0.4798        | 20.9  | 168  | 1.9771          | 0.6295 |
  | 0.5221        | 21.9  | 176  | 1.9880          | 0.6235 |
  | 0.4862        | 22.9  | 184  | 2.0994          | 0.6298 |
  | 0.4831        | 23.9  | 192  | 2.0521          | 0.6205 |
  | 0.4952        | 24.9  | 200  | 1.9838          | 0.6064 |
  | 0.4952        | 25.9  | 208  | 2.0319          | 0.6103 |
  | 0.5119        | 26.9  | 216  | 2.0419          | 0.6160 |
  | 0.4996        | 27.9  | 224  | 2.0073          | 0.6178 |
  | 0.488         | 28.9  | 232  | 2.1740          | 0.6304 |
  | 0.4978        | 29.9  | 240  | 2.2731          | 0.6163 |
  | 0.4978        | 30.9  | 248  | 2.2420          | 0.6205 |
  | 0.5259        | 31.9  | 256  | 2.0561          | 0.6184 |
  | 0.47          | 32.9  | 264  | 1.9455          | 0.6136 |
  | 0.5132        | 33.9  | 272  | 1.9307          | 0.6043 |
  | 0.4972        | 34.9  | 280  | 2.0536          | 0.6127 |
  | 0.4972        | 35.9  | 288  | 1.9113          | 0.6223 |
  | 0.5147        | 36.9  | 296  | 1.9317          | 0.6286 |
  | 0.4914        | 37.9  | 304  | 2.1810          | 0.6241 |
  | 0.472         | 38.9  | 312  | 2.1403          | 0.6160 |
  | 0.4825        | 39.9  | 320  | 2.1141          | 0.6094 |
  | 0.4825        | 40.9  | 328  | 2.2870          | 0.6031 |
  | 0.5138        | 41.9  | 336  | 2.1404          | 0.6181 |
  | 0.48          | 42.9  | 344  | 2.0243          | 0.6265 |
  | 0.4598        | 43.9  | 352  | 2.1117          | 0.6199 |
  | 0.474         | 44.9  | 360  | 2.0378          | 0.6321 |
  | 0.474         | 45.9  | 368  | 2.1919          | 0.6211 |
  | 0.4933        | 46.9  | 376  | 2.3645          | 0.6109 |
  | 0.4692        | 47.9  | 384  | 2.1920          | 0.6076 |
  | 0.4716        | 48.9  | 392  | 2.3663          | 0.6034 |
  | 0.4601        | 49.9  | 400  | 2.2838          | 0.6280 |
  | 0.4601        | 50.9  | 408  | 2.0287          | 0.6148 |
  | 0.4891        | 51.9  | 416  | 2.1346          | 0.6130 |
  | 0.4506        | 52.9  | 424  | 2.1556          | 0.6181 |
  | 0.4581        | 53.9  | 432  | 2.0560          | 0.6229 |
  | 0.4485        | 54.9  | 440  | 1.9944          | 0.5971 |
  | 0.4485        | 55.9  | 448  | 1.9791          | 0.6097 |
  | 0.4942        | 56.9  | 456  | 2.1166          | 0.6070 |
  | 0.4748        | 57.9  | 464  | 2.0271          | 0.6124 |
  | 0.4229        | 58.9  | 472 