ELECTRA-large-discriminator results are not stable
I'm fine tuning ELECTRA-large-discriminator (https://huggingface.co/google/electra-large-discriminator) for my classification task.
The problem is that the results are not stable. First time I fine tuned it with validation accuracy around 97%. The second try, i got 7x% accuracy. The third is 5x% accuracy. 
I just did the same job with BERT, RoBERTa,...
Anyone has any thoughts on this problem?

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.