Almost same as fine-tuning example, while running  trainer.train(). it takes so long(tens of minutes) before the model starting training. is that normal?
And, how could we use apex(torch) for faster fine-tuning using trainer?