where is the script of a second step of  knwoledge distillation on SQuAD 1.0?
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
In Distil part, there is a paragraph description which is "distilbert-base-uncased-distilled-squad: A finetuned version of distilbert-base-uncased finetuned using (a second step of) knwoledge distillation on SQuAD 1.0. This model reaches a F1 score of 86.9 on the dev set (for comparison, Bert bert-base-uncased version reaches a 88.5 F1 score)."
so where is the script of "a second step of  knwoledge distillation on SQuAD 1.0" mentioned above?
Thanks a lot, it will be very helpful to me!

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>Check here: https://github.com/huggingface/transformers/blob/master/examples/distillation/run_squad_w_distillation.py