AI can’t do hiring because it lacks the data
There&#x27;s always a lot of talk about meritocracy, but I want to convince you that this is an unachievable thing. We often hear &quot;it doesn&#x27;t matter your university&#x27;s prestige&#x2F;your credentials, just the quality of your work.&quot; As if the two don&#x27;t strongly correlate.<p>But the question is why they correlate. Social networks matter, a lot. If you&#x27;re at a top 10 university your university&#x27;s career fair is going to be filled with top companies. This isn&#x27;t true for less prestigious universities. If you&#x27;re a grad student, you also know that the connections your advisor has strongly correlates with your ability to get a job (nepotism playing a significant role here).<p>We also see everyone using LeetCode to filter candidates but there&#x27;s so much evidence that this is just a noisy filter. Not only do people cheat and succeed[0] but just consider how it is a meme that this doesn&#x27;t correlate with the actual job. Our whole community has the position &quot;study for the test, then forget it&quot;. Honestly, this feels insane to continue doing this, and to even pump more money into lifting this system up. We also know that grades are noisy[1] and does anyone remember those brain teasers that google used to do (also [1])? The ones that people still use?<p>So how do we hire? Well, to do that we need to look at what the job actually requires. But the job will change. We also need to know how well a candidate will work with the team. These are really difficult questions to answer and it would be insane to think that a resume or in person interview could be a non-noisy process (or at least where noise doesn&#x27;t dominate). Nepotism has succeeded because it is a decent filter. It has a lot of false rejects but it works because you are outsourcing a lot of questions to someone else that has intimate knowledge. It is easy to determine this, logically. You have three candidates who all perform equally well on their resumes, interviews, and whatever. You only have this information for candidate A. Candidate B was recommended by a close friend who you trust. Candidate C also knows a close friend but that friend dislikes them. Who are you going to hire? Why? The nepotism is actually giving you more information. This is not an argument for nepotism but rather a illustration about how the blind interview process is highly noisy and that there is still a lot of missing information.<p>CS seems to be very weird in a lot of these respects. In a standard engineering job (e.g. Aerospace, electrical, mechanical) you generally send in your resume, talk with a few people (2-3 interviews) where a few technical questions will be asked, and that&#x27;s about it. Resume -&gt; phone screen (~30 minutes) -&gt; In person interview (30min - 90 min). No whiteboard problems&#x2F;puzzles. No take home tests&#x2F;projects. In person interviews have several engineers on the team that is hiring and they ask behavioral questions as well as a few relevant technical problems. At most you&#x27;d have to do a back of the napkin calculation. Why do these firms do it this way? They&#x27;ve recognized that the system is noisy and that essentially you apply a few filters and then just hire the person. In 3-6 months if they don&#x27;t work out, you let them go. If the hiring process is easy&#x2F;cheap then you can also turn over bad hires easily. It also isn&#x27;t uncommon to get a call 3-6 months down the line from your final interview. So you don&#x27;t always have to repeat the whole process because there are still often available candidates. I&#x27;ve met plenty of people who work at FAANG jobs and brag about how they work 20hrs a week making $150k&#x2F;yr. I&#x27;ve never met an engineer like that. Maybe that means something, maybe it doesn&#x27;t.<p>[0] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35885342" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35885342</a><p>[1] <a href="https:&#x2F;&#x2F;www.cnet.com&#x2F;culture&#x2F;google-gpas-are-worthless&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.cnet.com&#x2F;culture&#x2F;google-gpas-are-worthless&#x2F;</a>