How to initialize BigBird Encoder-Decoder model with weights of full_attention Transformer Encoder model like BERT
Hi, I am trying to train summarization model with [run_summarization.py](https://github.com/huggingface/transformers/blob/main/examples/pytorch/summarization/run_summarization.py).
As a starting point, I want to initialize BigBird Encoder-Decoder model with weights of full_attention Transformer Encoder model (e.g. BERT, [SPECTER](https://huggingface.co/allenai/specter))

What should I do?
Thanks.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.