Hi @rsvarma  !
FYI, my ELECTRA reimplementation has successfully replicated the results in the paper.
Code: https://github.com/richarddwang/electra_pytorch 11
Post: ELECTRA training reimplementation and discussion 4