slow training speed even 20 steps
Hi,
I am running run_lm_finetuning.py code on a 1 million sentences .
It's taking more than 20 hours even for each epoch. 

where as run_pretraining.py code from google-research/bert takes very less time.

What can be the reason?

How to resolve this?
We have new lm_fintetuning scripts thanks to @Rocketknight1 PR #392.
Maybe you can try these ones.
They are in the `./examples/lm_finetuning/` folder.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
