readme: This repository is used to debug models, functionalities in transformers, etc...
  
  # 1. Generation
  
  ...
  
  # 2. Flax Wav2Vec2 Pretraining
  
  Go into the `flax_wav2vec2` folder.
  
  1. **Check PT loss works correctly**
  
  `./run_pt_fsq_comp.sh` shows that HF PyTorch and Fairseq PT yield equivalent loss. Make sure to use the correct library versions as defined `branches_to_use.txt`.
  
  2. **Check Flax loss works correctly**
  
  `./run_flax_fsq_comp.sh` shows that HF PyTorch and HF Flax yield equivalent loss. Make sure to use the correct library versions as defined `branches_to_use.txt`.