readme: ---
  tags:
  - espnet
  - audio
  - automatic-speech-recognition
  language: en
  datasets:
  - fsc_challenge
  license: cc-by-4.0
  ---
  
  ## ESPnet2 ASR model 
  
  ### `espnet/fsc_challenge_slu_2pass_transformer`
  
  This model was trained by Siddhant using fsc_challenge recipe in [espnet](https://github.com/espnet/espnet/).
  
  ### Demo: How to use in ESPnet2
  
  Follow the [ESPnet installation instructions](https://espnet.github.io/espnet/installation.html)
  if you haven't done that already.
  
  ```bash
  cd espnet
  git checkout 3b54bfe52a294cdfce668c20d777bfa65f413745
  pip install -e .
  cd egs2/fsc_challenge/slu1
  ./run.sh --skip_data_prep false --skip_train true --download_model espnet/fsc_challenge_slu_2pass_transformer
  ```
  
  <!-- Generated by scripts/utils/show_asr_result.sh -->
  # RESULTS
  ## Environments
  - date: `Tue Feb  1 13:38:02 EST 2022`
  - python version: `3.8.11 (default, Aug  3 2021, 15:09:35)  [GCC 7.5.0]`
  - espnet version: `espnet 0.10.3a3`
  - pytorch version: `pytorch 1.9.0+cu102`
  - Git hash: `97b9dad4dbca71702cb7928a126ec45d96414a3f`
    - Commit date: `Mon Sep 13 22:55:04 2021 +0900`
  
  ## asr_train_asr_hubert_transformer_adam_specaug_deliberation_transformer_raw_en_word
  ### WER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  |inference_asr_model_valid.acc.ave_5best/spk_test|3349|17937|98.6|1.0|0.4|0.3|1.7|4.4|
  |inference_asr_model_valid.acc.ave_5best/spk_test_1|3349|17937|35.2|30.8|33.9|2.1|66.8|82.0|
  |inference_asr_model_valid.acc.ave_5best/spk_test_2|3349|17937|92.6|3.1|4.3|0.4|7.8|14.2|
  |inference_asr_model_valid.acc.ave_5best/spk_test_3|3349|17937|98.3|1.1|0.6|0.3|2.1|5.2|
  |inference_asr_model_valid.acc.ave_5best/spk_test_4|3349|17937|98.6|1.0|0.4|0.3|1.7|4.5|
  |inference_asr_model_valid.acc.ave_5best/spk_test_5|3349|17937|98.6|1.0|0.4|0.3|1.7|4.4|
  |inference_asr_model_valid.acc.ave_5best/utt_test|4204|22540|87.7|10.2|2.2|2.8|15.1|42.9|
  |inference_asr_model_valid.acc.ave_5best/utt_test_1|4204|22540|30.4|34.6|34.9|3.0|72.5|96.4|
  |inference_asr_model_valid.acc.ave_5best/utt_test_2|4204|22540|82.1|12.3|5.6|3.0|20.9|51.6|
  |inference_asr_model_valid.acc.ave_5best/utt_test_3|4204|22540|87.2|10.3|2.5|2.8|15.6|43.3|
  |inference_asr_model_valid.acc.ave_5best/utt_test_4|4204|22540|87.5|10.2|2.2|2.8|15.2|43.0|
  |inference_asr_model_valid.acc.ave_5best/utt_test_5|4204|22540|87.6|10.2|2.2|2.8|15.2|43.0|
  |inference_asr_model_valid.acc.ave_5best/valid|2597|13782|98.8|0.7|0.5|0.2|1.5|3.1|
  
  ### CER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  |inference_asr_model_valid.acc.ave_5best/spk_test|3349|152191|99.3|0.3|0.3|0.2|0.9|4.4|
  |inference_asr_model_valid.acc.ave_5best/spk_test_1|3349|152191|56.2|15.7|28.1|3.3|47.1|82.0|
  |inference_asr_model_valid.acc.ave_5best/spk_test_2|3349|152191|95.5|1.2|3.3|0.3|4.8|14.2|
  |inference_asr_model_valid.acc.ave_5best/spk_test_3|3349|152191|99.1|0.4|0.5|0.2|1.1|5.2|
  |inference_asr_model_valid.acc.ave_5best/spk_test_4|3349|152191|99.3|0.3|0.3|0.2|0.9|4.5|
  |inference_asr_model_valid.acc.ave_5best/spk_test_5|3349|152191|99.3|0.3|0.3|0.2|0.9|4.4|
  |inference_asr_model_valid.acc.ave_5best/utt_test|4204|191435|93.8|4.0|2.1|2.9|9.1|42.9|
  |inference_asr_model_valid.acc.ave_5best/utt_test_1|4204|191435|52.8|17.8|29.4|4.3|51.4|96.4|
  |inference_asr_model_valid.acc.ave_5best/utt_test_2|4204|191435|90.2|5.0|4.9|3.0|12.9|51.6|
  |inference_asr_model_valid.acc.ave_5best/utt_test_3|4204|191435|93.5|4.1|2.4|2.9|9.4|43.3|
  |inference_asr_model_valid.acc.ave_5best/utt_test_4|4204|191435|93.8|4.0|2.2|2.9|9.1|43.0|
  |inference_asr_model_valid.acc.ave_5best/utt_test_5|4204|191435|93.8|4.0|2.2|2.9|9.1|43.0|
  |inference_asr_model_valid.acc.ave_5best/valid|2597|117282|99.3|0.3|0.3|0.2|0.8|3.1|
  
  ### TER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  
  ## ASR config
  
  <details><summary>expand</summary>
  
  ```
  config: conf/tuning/train_asr_hubert_transformer_adam_specaug_deliberation_transformer.yaml
  print_config: false
  log_level: INFO
  dry_run: false
  iterator_type: sequence
  output_dir: exp/asr_train_asr_hubert_transformer_adam_specaug_deliberation_transformer_raw_en_word
  ngpu: 1
  seed: 0
  num_workers: 1
  num_att_plot: 3
  dist_backend: nccl
  dist_init_method: env://
  dist_world_size: null
  dist_rank: null
  local_rank: 0
  dist_master_addr: null
  dist_master_port: null
  dist_launcher: null
  multiprocessing_distributed: false
  unused_parameters: false
  sharded_ddp: false
  cudnn_enabled: true
  cudnn_benchmark: false
  cudnn_deterministic: true
  collect_stats: false
  write_collected_feats: false
  max_epoch: 80
  patience: null
  val_scheduler_criterion:
  - valid
  - loss
  early_stopping_criterion:
  - valid
  - loss
  - min
  best_model_criterion:
  -   - train
      - loss
      - min
  -   - valid
      - loss
      - min
  -   - train
      - acc
      - max
  -   - valid
      - acc
      - max
  keep_nbest_models: 5
  grad_clip: 5.0
  grad_clip_type: 2.0
  grad_noise: false
  accum_grad: 1
  no_forward_run: false
  resume: true
  train_dtype: float32
  use_amp: false
  log_interval: null
  use_tensorboard: true
  use_wandb: fal