<i>If you&#x27;re concerned that humans are as smart as it&#x27;s possible to be</i><p>It&#x27;s not about humans being as smart as possible though, it&#x27;s more about being &quot;smart enough&quot; to where a hypothetical &quot;smarter than human AI&quot; is not analogous to a nuclear bomb.  That is, are we smart enough to where a super-AGI can&#x27;t come up anything fundamentally new, that humans aren&#x27;t capable of coming up with, as bound by the fundamental laws of nature.<p><i>then I would recommend reading Thinking Fast and Slow or some other book on cognitive psychology</i><p>I&#x27;m reading <i>Thinking, Fast and Slow</i> right now, actually.<p>And just to re-iterate this point: I&#x27;m not arguing <i>for</i> this position, just putting it out there as a thought experiment &#x2F; discussion topic.   I&#x27;m certainly not convinced this is true, it&#x27;s just a possibility that occurred to me earlier while reading TFA.