NLP's ImageNet Moment: From Shallow to Deep Pre-Training
The title is a little too click-baity for my taste ("has arrived," huh?), but I think the OP is unto something.It is now possible to grab a pretrained model and start producing state-of-the-art NLP results in a wide range of tasks with relatively little effort.This will likely enable much more tinkering with NLP, all around the world... which will lead to new SOTA results in a range of tasks.