BERT generating prediction in 120sec approx using squad 2.0 in prediction.json
I am using the below command to predict the question answer using BERT with squad but it taking too long to generate the prediction.json approx 120 sec. I wanna reduce this time to 10secs.

run_squad.py --vocab_file=uncased_L-12_H-768_A-12/vocab.txt --bert_config_file=uncased_L-12_H-768_A-12/bert_config.json --init_checkpoint=model.ckpt-21899 --do_train=False --train_file=train-v1.1.json --do_predict=True --train_batch_size=32 --learning_rate=5e-5 --num_train_epochs=3.0 --max_seq_length=384 --doc_stride=128 --version_2_with_negative=True --output_dir=/ --predict_file=input.json --use_tpu=False

Please suggest me some solution.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
