Cerebras-GPT vs. LLaMA AI Model Performance Comparison
&gt;&gt;Is 10000 bigger than 10050?<p>&gt;&gt;Yes, 10000 is bigger than 10050.<p>&gt;But even the mighty ChatGPT often can&#x27;t do simple math<p>GPT is bad at math because BPE input compression obfuscates individual digits. <a href="https:&#x2F;&#x2F;bbot.org&#x2F;etc&#x2F;gpt-math.png" rel="nofollow">https:&#x2F;&#x2F;bbot.org&#x2F;etc&#x2F;gpt-math.png</a> You&#x27;d be bad at math too if every number was scrambled.<p>The graph is from page 22 of the GPT-3 paper from 2020. <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2005.14165" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2005.14165</a> Even with 175 billion parameters it can&#x27;t reliably do four digit addition.<p>An example from 4 days ago of ChatGPT being as bad as you&#x27;d expect at string reversal: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35297183" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=35297183</a><p>(Although, I just tested ChatGPT Mar 14 Version against the above question after doing a bunch of math prompting and it got it right...)