XLNet fine-tuning speed (Multi-label classification)
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
Hi!

I'm wondering whether my speed of fine-tuning is normal.

Training is taking **2~3hours per epoch**.

I am using [fast-bert](https://github.com/kaushaltrivedi/fast-bert) to train multi-label classifier, with
- model = xlnet-base-cased
- max sequence length = 512 tokens
- mem states using = no
- gpu = V100 * 4
- training data amount = 110000 ~ 120000
- validation data amount = 30000 ~ 40000
- evaluation = per each epoch, per every 100 steps
- apex, f16 used

Thank you so much!





This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
