Added Squad 2.0
Accidentally closed the last pull request. Created Separate file for Squad 2.0 run with 
python3 run_squad.py 
--bert_model bert-large-uncased_up 
--do_predict 
--do_lower_case 
--train_file squad/train-v2.0.json 
--predict_file squad/dev-v2.0.json 
--learning_rate 3e-5 
--num_train_epochs 2 
--max_seq_length 384 
--doc_stride 128 
--output_dir squad2_diff 
--train_batch_size 24 
--fp16 
--loss_scale 128 
--null_score_diff_threshold -2.6929588317871094
If null score not defined default value is 0.0
Great, thanks @abeljim.
Do you have the associated results when you run this command?<|||||>python run_squad2.py \
  --bert_model bert-large-uncased \
  --do_train \
  --do_predict \
  --do_lower_case \
  --train_file $SQUAD_DIR/train-v2.0.json \
  --predict_file $SQUAD_DIR/dev-v2.0.json \
  --train_batch_size 24 \
  --learning_rate 3e-5 \
  --num_train_epochs 2.0 \
  --max_seq_length 384 \
  --doc_stride 128 \
  --output_dir ./debug_squad/ \
  --fp16 \
  --loss_scale 128 \
  --null_score_diff_threshold -2.6929588317871094

{
  "exact": 76.62764255032427,
  "f1": 79.22523967450329,
  "total": 11873,
  "HasAns_exact": 68.31983805668017,
  "HasAns_f1": 73.52248155455082,
  "HasAns_total": 5928,
  "NoAns_exact": 84.9116904962153,
  "NoAns_f1": 84.9116904962153,
  "NoAns_total": 5945
}
This is the command I used and the results<|||||>how much time does it take to train?
