AI hype is built on flawed test scores
I don&#x27;t think the &quot;hype&quot; is built on test scores.<p>It is built on the observation how fast AI is getting better. If the speed of improvement stays anywhere near the level it was the last two years, then over the next two decades, it will lead to massive changes in how we work and which skills are valuable.<p>Just two years ago, I was mesmerized by GPT-3&#x27;s ability to understand concepts:<p><a href="https:&#x2F;&#x2F;twitter.com&#x2F;marekgibney&#x2F;status&#x2F;1403414210642649092" rel="nofollow noreferrer">https:&#x2F;&#x2F;twitter.com&#x2F;marekgibney&#x2F;status&#x2F;1403414210642649092</a><p>Nowadays, using it daily in a productive fashion feels completely normal.<p>Yesterday, I was annoyed with how cumbersome it is to play long mp3s on my iPad. I asked GPT-4 something like &quot;Write an html page which lets me select an mp3, play it via play&#x2F;pause buttons and offers me a field to enter a time to jump to&quot;. And the result was usable out of the box and is my default mp3 player now.<p>Two years ago it didn&#x27;t even dawn on me that this would be my way of writing software in the near future. I have been coding for over 20 years. But for little tools like this, it is faster to ask ChatGPT now.<p>It&#x27;s hard to imagine where we will be in 20 years.