Run_mlm.py for fine-tuning generator(mlm) of electra 
Hi, I have a new corpus and want to fine-tune ELECTRA for better result. ELECTRA used generator as generator after that used discriminator. Can run file run_mlm.py makes my pre-trained electra works better ?
Hi @ToanKGO,

I think the latest update on the ELECTRA pretraining/fine-tuning is this comment from @LysandreJik :+1: 
https://github.com/huggingface/transformers/pull/4656#issuecomment-711082850

So you could use e.g. this implementation: https://github.com/richarddwang/electra_pytorch<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.