readme: ---
  language:
  - en
  ---
  
  BigBirdPegasus weights before finetuning as per [this](https://github.com/google-research/bigbird) repo.
  Converted to PyTorch as per [this](https://github.com/huggingface/transformers/blob/v4.25.1/src/transformers/models/bigbird_pegasus/convert_bigbird_pegasus_tf_to_pytorch.py) script.