tf electra pretraining en transformers license:apache-2.0
.gitattributes README.md config.json tf_model.h5
---
language: en
license: apache-2.0
---

## ELECTRA-small-cased

This is a cased version of `google/electra-small-discriminator`, trained on the
[OpenWebText corpus](https://skylion007.github.io/OpenWebTextCorpus/).

Uses the same tokenizer and vocab from `bert-base-cased`
