Misidentifying talent
It’s striking that so many stories about the triumph of metrics over intuition involve games. I’m convinced that you should put statisticians in charge if your goal is to win a game. I’m not convinced that related behaviors, like constructing a game adjacent to the problem you’re actually trying to solve and treating game performance as a proxy (like LeetCode interviews! Or KPIs!) are helpful.<p>It’s also interesting that he brings up the blind audition here in the appendix. Blinding can of course remove biases <i>about the person</i> from the process, but it is still subjective. To make the “can’t manage what you don’t measure” point we would need to show that orchestra performance got better after we developed an algorithmic way of deciding how good an audition performance is. After all millions of dollars are on the line, are you really going to listen to some credentialed old man about which one he liked better? So backwards!