Cannot reproduce the result of run_squad 1.1
I train 5 epochs with learning rate 5e-5, but my evaluation result is {'exact_match': 32.04351939451277, 'f1': 36.53574674513405}.
What is the problem?
I can reproduce the results, learning rate is 3e-5 , epoch is 2.0<|||||>by using fp16, the f1 is 90.8 <|||||>> by using fp16, the f1 is 90.8

So the key is set fp16 is True?<|||||>@hmt2014 could you give the exact command line that you use to train your model?<|||||>Yes, please use the command line example indicated [here](https://github.com/huggingface/pytorch-pretrained-BERT#squad) in the readme for SQuAD.