readme: ---
  tags:
  - espnet
  - audio
  - automatic-speech-recognition
  language: en
  datasets:
  - fsc_challenge
  license: cc-by-4.0
  ---
  
  ## ESPnet2 ASR model 
  
  ### `espnet/fsc_challenge_slu_2pass_transformer_gt`
  
  This model was trained by Siddhant using fsc_challenge recipe in [espnet](https://github.com/espnet/espnet/).
  
  ### Demo: How to use in ESPnet2
  
  Follow the [ESPnet installation instructions](https://espnet.github.io/espnet/installation.html)
  if you haven't done that already.
  
  ```bash
  cd espnet
  git checkout 3b54bfe52a294cdfce668c20d777bfa65f413745
  pip install -e .
  cd egs2/fsc_challenge/slu1
  ./run.sh --skip_data_prep false --skip_train true --download_model espnet/fsc_challenge_slu_2pass_transformer_gt
  ```
  
  <!-- Generated by scripts/utils/show_asr_result.sh -->
  # RESULTS
  ## Environments
  - date: `Sun Mar 13 20:59:06 EDT 2022`
  - python version: `3.8.11 (default, Aug  3 2021, 15:09:35)  [GCC 7.5.0]`
  - espnet version: `espnet 0.10.3a3`
  - pytorch version: `pytorch 1.9.0+cu102`
  - Git hash: `97b9dad4dbca71702cb7928a126ec45d96414a3f`
    - Commit date: `Mon Sep 13 22:55:04 2021 +0900`
  
  ## asr_train_asr_hubert_transformer_adam_specaug_deliberation_transformer_3_raw_en_word
  ### WER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  |inference_asr_model_valid.acc.ave_5best/spk_test|3349|17937|99.9|0.1|0.0|0.0|0.1|0.6|
  |inference_asr_model_valid.acc.ave_5best/utt_test|4204|22540|89.8|6.6|3.6|0.0|10.2|27.6|
  
  ### CER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  |inference_asr_model_valid.acc.ave_5best/spk_test|3349|152191|100.0|0.0|0.0|0.0|0.1|0.6|
  |inference_asr_model_valid.acc.ave_5best/utt_test|4204|191435|94.5|2.8|2.7|0.5|6.0|27.6|
  
  ### TER
  
  |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
  |---|---|---|---|---|---|---|---|---|
  
  ## ASR config
  
  <details><summary>expand</summary>
  
  ```
  config: conf/tuning/train_asr_hubert_transformer_adam_specaug_deliberation_transformer_3.yaml
  print_config: false
  log_level: INFO
  dry_run: false
  iterator_type: sequence
  output_dir: exp/asr_train_asr_hubert_transformer_adam_specaug_deliberation_transformer_3_raw_en_word
  ngpu: 1
  seed: 0
  num_workers: 1
  num_att_plot: 3
  dist_backend: nccl
  dist_init_method: env://
  dist_world_size: null
  dist_rank: null
  local_rank: 0
  dist_master_addr: null
  dist_master_port: null
  dist_launcher: null
  multiprocessing_distributed: false
  unused_parameters: false
  sharded_ddp: false
  cudnn_enabled: true
  cudnn_benchmark: false
  cudnn_deterministic: true
  collect_stats: false
  write_collected_feats: false
  max_epoch: 25
  patience: null
  val_scheduler_criterion:
  - valid
  - loss
  early_stopping_criterion:
  - valid
  - loss
  - min
  best_model_criterion:
  -   - train
      - loss
      - min
  -   - valid
      - loss
      - min
  -   - train
      - acc
      - max
  -   - valid
      - acc
      - max
  keep_nbest_models: 5
  grad_clip: 5.0
  grad_clip_type: 2.0
  grad_noise: false
  accum_grad: 1
  no_forward_run: false
  resume: true
  train_dtype: float32
  use_amp: false
  log_interval: null
  use_tensorboard: true
  use_wandb: false
  wandb_project: null
  wandb_id: null
  wandb_entity: null
  wandb_name: null
  wandb_model_log_interval: -1
  detect_anomaly: false
  pretrain_path: null
  init_param:
  - ../../fsc_challenge/asr1/exp/asr_train_asr_hubert_transformer_adam_specaug_old_raw_en_word/valid.acc.ave_5best.pth:encoder:encoder
  ignore_init_mismatch: false
  freeze_param:
  - encoder
  - postdecoder.model
  - frontend.upstream
  num_iters_per_epoch: null
  batch_size: 20
  valid_batch_size: null
  batch_bins: 1000000
  valid_batch_bins: null
  train_shape_file:
  - exp/asr_stats_raw_en_word/train/speech_shape
  - exp/asr_stats_raw_en_word/train/text_shape.word
  - exp/asr_stats_raw_en_word/train/transcript_shape.word
  valid_shape_file:
  - exp/asr_stats_raw_en_word/valid/speech_shape
  - exp/asr_stats_raw_en_word/valid/text_shape.word
  - exp/asr_stats_raw_en_word/valid/transcript_shape.word
  batch_type: folded
  valid_batch_type: null
  fold_length:
  - 80000
  - 150
  - 150
  sort_in_batch: descending
  sort_batch: descending
  multiple_iterator: false
  chunk_length: 500
  chunk_shift_ratio: 0.5
  num_cache_chunks: 1024
  train_data_path_and_name_and_type:
  -   - dump/raw/train/wav.scp
      - speech
      - sound
  -   - dump/raw/train/text
      - text
      - text
  -   - dump/raw/train/transcript
      - transcript
      - text
  valid_data_path_and_name_and_type:
  -   - dump/raw/valid/wav.scp
      - speech
      - sound
  -   - dump/raw/valid/text
      - text
      - text
  -   - dump/raw/valid/transcript
      - transcript
      - text
  allow_variable_data_keys: false
  max_cache_size: 0.0
  max_cache_fd: 32
  valid_max_cache_size: null
  optim: adam
  optim_conf:
      lr: 0.0002
  scheduler: warmuplr
  scheduler_conf:
      warmup_steps: 25000
  token_list:
  - <blank>
  - <unk>
  - the
  - turn
  - lights
  - in
  - up
  - 'on'
  - down
  - temperature
  - heat
  - switch
  - kitchen
  - volume
  - 'off'
  - increase_volume_none
  - bedroom
  - washroom
  - decrease_volume_none
  - language
  - bathroom
  - decrease
  - my
  - to
  - increase
  - decrease_heat_washroom
  - increase_heat_washroom
  - music
  - heating
  - bring
  - increase_heat_non