readme: ---
  language:
  - zh
  license: apache-2.0
  tags:
  - automatic-speech-recognition
  - generated_from_trainer
  - hf-asr-leaderboard
  - mozilla-foundation/common_voice_8_0
  - robust-speech-event
  - zh-HK
  datasets:
  - mozilla-foundation/common_voice_8_0
  model-index:
  - name: XLS-R-300M - Chinese_HongKong (Cantonese)
    results:
    - task:
        name: Automatic Speech Recognition
        type: automatic-speech-recognition
      dataset:
        name: Common Voice 8
        type: mozilla-foundation/common_voice_8_0
        args: zh-hk
      metrics:
      - name: Test WER
        type: wer
        value: 0.8111349803079126
      - name: Test CER
        type: cer
        value: 0.21962250882996914
    - task:
        name: Automatic Speech Recognition
        type: automatic-speech-recognition
      dataset:
        name: Robust Speech Event - Dev Data
        type: speech-recognition-community-v2/dev_data
        args: zh-hk
      metrics:
      - name: Test WER
        type: wer
        value: 1.0
      - name: Test CER
        type: cer
        value: 0.6160564326503191
    - task:
        name: Automatic Speech Recognition
        type: automatic-speech-recognition
      dataset:
        name: Common Voice 8
        type: mozilla-foundation/common_voice_8_0
        args: zh-HK
      metrics:
      - name: Test WER with LM
        type: wer
        value: 0.8055853920515574
      - name: Test CER with LM
        type: cer
        value: 0.21578686612008757
    - task:
        name: Automatic Speech Recognition
        type: automatic-speech-recognition
      dataset:
        name: Robust Speech Event - Dev Data
        type: speech-recognition-community-v2/dev_data
        args: zh-HK
      metrics:
      - name: Test WER with LM
        type: wer
        value: 1.0012453300124533
      - name: Test CER with LM
        type: cer
        value: 0.6153006382264025
    - task:
        name: Automatic Speech Recognition
        type: automatic-speech-recognition
      dataset:
        name: Robust Speech Event - Test Data
        type: speech-recognition-community-v2/eval_data
        args: zh-HK
      metrics:
      - name: Test CER
        type: cer
        value: 61.55
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # 
  
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - ZH-HK dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.4848
  - Wer: 0.8004
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 0.0003
  - train_batch_size: 32
  - eval_batch_size: 16
  - seed: 42
  - gradient_accumulation_steps: 2
  - total_train_batch_size: 64
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_steps: 500
  - num_epochs: 100.0
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Wer    |
  |:-------------:|:-----:|:-----:|:---------------:|:------:|
  | No log        | 1.0   | 183   | 47.8442         | 1.0    |
  | No log        | 2.0   | 366   | 6.3109          | 1.0    |
  | 41.8902       | 3.0   | 549   | 6.2392          | 1.0    |
  | 41.8902       | 4.0   | 732   | 5.9739          | 1.1123 |
  | 41.8902       | 5.0   | 915   | 4.9014          | 1.9474 |
  | 5.5817        | 6.0   | 1098  | 3.9892          | 1.0188 |
  | 5.5817        | 7.0   | 1281  | 3.5080          | 1.0104 |
  | 5.5817        | 8.0   | 1464  | 3.0797          | 0.9905 |
  | 3.5579        | 9.0   | 1647  | 2.8111          | 0.9836 |
  | 3.5579        | 10.0  | 1830  | 2.6726          | 0.9815 |
  | 2.7771        | 11.0  | 2013  | 2.7177          | 0.9809 |
  | 2.7771        | 12.0  | 2196  | 2.3582          | 0.9692 |
  | 2.7771        | 13.0  | 2379  | 2.1708          | 0.9757 |
  | 2.3488        | 14.0  | 2562  | 2.0491          | 0.9526 |
  | 2.3488        | 15.0  | 2745  | 1.8518          | 0.9378 |
  | 2.3488        | 16.0  | 2928  | 1.6845          | 0.9286 |
  | 1.7859        | 17.0  | 3111  | 1.6412          | 0.9280 |
  | 1.7859        | 18.0  | 3294  | 1.5488          | 0.9035 |
  | 1.7859        | 19.0  | 3477  | 1.4546          | 0.9010 |
  | 1.3898        | 20.0  | 3660  | 1.5147          | 0.9201 |
  | 1.3898        | 21.0  | 3843  | 1.4467          | 0.8959 |
  | 1.1291        | 22.0  | 4026  | 1.4743          | 0.9035 |
  | 1.1291        | 23.0  | 4209  | 1.3827          | 0.8762 |
  | 1.1291        | 24.0  | 4392  | 1.3437          | 0.8792 |
  | 0.8993        | 25.0  | 4575  | 1.2895          | 0.8577 |
  | 0.8993        | 26.0  | 4758  | 1.2928          | 0.8558 |
  | 0.8993        | 27.0  | 4941  | 1.2947          | 0.9163 |
  | 0.6298        | 28.0  | 5124  | 1.3151          | 0.8738 |
  | 0.6298        | 29.0  | 530