  layer is used.
The ELECTRA checkpoints saved using Google Research's implementation
  contain both the generator and discriminator. The conversion script requires the user to name which model to export
  into the correct architecture. Once converted to the HuggingFace format, these checkpoints may be loaded into all
  available ELECTRA models, however. This means that the discriminator may be loaded in the
  [ElectraForMaskedLM] model, and the generator may be loaded in the
  [ElectraForPreTraining] model (the classification head will be randomly initialized as it
  doesn't exist in the generator).
This model was contributed by lysandre. The original code can be found here.
ElectraConfig
[[autodoc]] ElectraConfig
ElectraTokenizer
[[autodoc]] ElectraTokenizer
ElectraTokenizerFast
[[autodoc]] ElectraTokenizerFast
