Machine Learning, NLP, Computer Vision, Information Retrieval, Transformers.
Gao, Adam Fisch and Danqi Chen. 🎖Why: we won’t be deploying GPT-3 sized models anytime soon because of the resources it requires, but we’re all in for bringing the surprising few-shot capabilities to smaller models! 💡Key insights: arguably, the main GPT-3 contribution was the surprising few and