Do you want to fine-tune or pre-train an ELECTRA model? If you want to fine-tune it, you can leverage the examples/run_language_modeling.py script.
If you want to pre-train it, your best bet is to use the original implementation (in TF1) and then convert it to our library using our conversion script which is here 47.
Here’s a PR 69 for pre-training ELECTRA with our library but it’s not working right now and we don’t have the bandwidth to get back into it right now.