What is Synthetic Self-Training?
The current best performing model on[ SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/) is BERT + N-Gram Masking + Synthetic Self-Training (ensemble):

![image](https://user-images.githubusercontent.com/2398765/54234467-24466380-454a-11e9-8674-d9e7004da027.png)

What is Synthetic Self-Training?

Check Jacob Devlin slides starting from slide 26 [here](https://nlp.stanford.edu/seminar/details/jdevlin.pdf?fbclid=IwAR2TBFCJOeZ9cGhxB-z5cJJ17vHN4W25oWsjI8NqJoTEmlYIYEKG7oh4tlY)<|||||>@thomwolf thanks, the slides were helpful. Do you know if there is a recording of the talk publicly available somewhere?<|||||>I don't know!<|||||>It was a very crowded room and these talks are generally not recorded, sorry…<|||||>Is the synthetic self training module in this code?<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>Same question, will the synthetic self training module be in this code?<|||||>Presently not in the library and there are no short-term plans to add synthetic self-training to the library.