The impossibility of intelligence explosion
This article is typical of many that claim proven limits on the feasibility (or, in this case, the capabilities) of generalized artificial intelligence, in that it structures the argument in a way designed to avoid discussion of the issue.<p>It starts by claiming that there is no such thing as general intelligence. What specialized intelligence, then, is human intelligence? It&#x27;s specialized for &quot;being human&quot;. The author is apparently unaware that this tautological response eliminates the distinction between general and specialized intelligence, as one could just as validly (or vacuously) say that a superhuman intelligence is specialized in being what it is and doing what it does. The author has invalidated the hook on which he had hung his argument.<p>A lot of column-inches are expended on repeatedly restating that animal intelligences have co-evolved with their sensorimotor systems, which is a contingent fact of history, not a fundamental necessity for intelligence (as far as we know; but then the whole article is predicated on the feasibility of AI.) He raises the &#x27;brain in a vat&#x27; trope, but no-one is suggesting that AIs must be disconnected from the external world. Furthermore, this line of argument ignores the fact that many of the greatest achievements of human intelligence have come from contemplating abstract ideas.<p>When the author writes &quot;most of our intelligence is not in our brain, it is externalized as our civilization&quot;, he is confusing the achievements of intelligent agents for intelligence itself. When he writes that &quot;an individual brain cannot implement recursive intelligence augmentation&quot; he is confusing a limit on human capabilities for a fundamental limit on intelligence itself...<p>I am far from convinced that the singularity must follow from achieving human-level artificial intelligence, as we don&#x27;t know how to get to the starting line, let alone know how the problem of bootstrapping intelligence scales, but the arguments presented here do nothing to persuade me that it is impossible.