That’s really fast. I would love to join. 
BTW we can already sample from the pre-trained BERT just with proper parametrizations and sampling schemes (like this 8). It seems their results are comparable except for the speed which is the main point.