Apple’s new Transformer-powered predictive text model
We might ask ourselves at some point: if the point of simple text prediction is to speed up text entry, and not generate large amounts of text from scratch, then that's a sign the input interfaces are the bottleneck. If we had a way to get text from our brains to the computer faster, we wouldn't need this kind of prediction.