How many epochs are necessary for finetuning BERT?
Hi,
Could somebody provide some insights on how many epochs are necessary for finetuning bert model?
Google BERT has 100000 steps.(total_data/batch_size)

flags.DEFINE_integer("num_train_steps", 100000, "Number of training steps.") 

Thanks
Mahesh
I have tried to finetune GPT rather than BERT. An appropriate running epochs is **3** in the generation setting, including learning on embedding of some custom special tokens. Hope it help you :)<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
