Rodney Brooks on GPT-4
GPT-4 is pretty amazing but I, too, feel this is being overhyped. For me, a sobering example is how OpenAI does math (eg [1]). Specifically, the model clearly doesn&#x27;t really understand multiplication and &quot;learns&quot; it from training data. This tends to get the first few and last few digits right for a simple multiplication with 6-7 digit numbers.<p>Now you can solve that with plugins (eg training the model to recognize math problems and have access to a calculator) so it&#x27;s a solvable problem but you realize there&#x27;s an extremely long tail of such problems. It goes to show that GPT-4 isn&#x27;t &quot;magic&quot; and we still have a long way to go.<p>[1]: <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;OpenAI&#x2F;comments&#x2F;12donja&#x2F;gpt4_and_math&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;OpenAI&#x2F;comments&#x2F;12donja&#x2F;gpt4_and_ma...</a>