Open AI gets GPT-3 to work by hiring an army of humans to fix GPT’s bad answers
I have respect for Andrew Gelman, but this is a bad take.1. This is presented as humans hard coding answers to the prompts. No way is that the full picture. If you try out his prompts the responses are fairly invariant to paraphrases. Hard coded answers don't scale like that.2. What is actually happening is far more interesting and useful. I believe that OpenAI are using the InstructGPT algo (RL on top of the trained model) to improve the general model based on human preferences.3. 40 people is a very poor army.