List:
☐ (Optional) Understood theoretical aspects
☐ Prepared transformers dev environment
☐ Set up debugging environment of the original repository
☐ Created script that successfully runs forward pass using original repository and checkpoint
☐ Successfully added the model skeleton to Transformers
☐ Successfully converted original checkpoint to Transformers checkpoint
☐ Successfully ran forward pass in Transformers that gives identical output to original checkpoint
☐ Finished model tests in Transformers
☐ Successfully added Tokenizer in Transformers
☐ Run end-to-end integration tests
☐ Finished docs
☐ Uploaded model weights to the hub
☐ Submitted the pull request
☐ (Optional) Added a demo notebook
To begin with, we usually recommend to start by getting a good theoretical understanding of BrandNewBert. However,
