My attempts are failing except the very first one.

Screen Shot 2021-03-29 at 12.23.132170×698 154 KB

The first run went seemingly well, but I ended up with an empty file 

Screen Shot 2021-03-29 at 12.24.552256×88 9.99 KB

I’ll try to remove the object storage instance and start all over again.
P.S. The last run’s WER score was about ~0.45 with the following params:
#!/usr/bin/env bash
python run_common_voice.py 
–model_name_or_path=“facebook/wav2vec2-large-xlsr-53” 
–dataset_config_name=“ky” 
–output_dir=/workspace/output_models/ky6/wav2vec2-large-xlsr-kyrgyz-demo 
–cache_dir=/workspace/data/ky 
–overwrite_output_dir 
–num_train_epochs=“15” 
–per_device_train_batch_size=“16” 
–per_device_eval_batch_size=“16” 
–evaluation_strategy=“steps” 
–learning_rate=“2.34e-4” 
–warmup_steps=“500” 
–fp16 
–freeze_feature_extractor 
–save_steps=“1000” 
–eval_steps=“1000” 
–save_total_limit=“2” 
–dataloader_num_workers=“8” 
–logging_steps=“4000” 
–group_by_length 
–feat_proj_dropout=“0.0” 
–attention_dropout=“0.094” 
–activation_dropout=“0.055” 
–hidden_dropout=“0.047” 
–feat_proj_dropout=“0.04” 
–mask_time_prob=“0.0082” 
–layerdrop=“0.041” 
–gradient_checkpointing 
–do_train --do_eval
This is the code I ran in OVH:
  
      
      github.com
  
  
    

jqueguiner/wav2vec2-sprint 2


  docker for HF wav2vec2-sprint. Contribute to jqueguiner/wav2vec2-sprint development by creating an account on GitHub.

  
  
    
    
  
  


The params given above were applied in finetune.sh