&gt;There are savants who can do amazing feats of mental arithmetic, yet have severe mental disabilities in other areas.<p>There are also geniuses who can do amazing feats of mental arithmetic and have no severe mental disabilities in any other areas. There are people who have perfect memories (and usually, they live totally normal lives but for the inability to forget a single event). There are people who are far better than average at recognizing faces, pattern recognition, and other tasks that are non-conscious.<p>The notion that there are &quot;fundamental limits&quot; that are for some reason near the typical human is the cognitive bias of the just-world fallacy. The world is not just. Bad things happen to good people. Good things happen to bad people. If there is a fundamental limit to how smart a mind can get, it&#x27;s very, very far above the typical human, because there are exceptional humans that are that far away and there&#x27;s no reason to think a computer couldn&#x27;t beat them either. Deep Blue beat Kasparov.<p>&gt;The humans who are in charge of our current society by virtue of having the most wealth, political power, or popularity aren&#x27;t necessarily the smartest or quickest thinkers, at least not in the way that most AGI researchers seem to be targeting.<p>I&#x27;m not at all familiar with AGI research, but while there are people who start out ahead, there&#x27;s no reason to think that you can&#x27;t actually play the game and win it. Winning challenges of acquiring wealth or political power or popularity are related to intelligence, insofar as the concept of intelligence is defined (as it is at least in psychology) as the ability to accomplish general goals.<p>Walking into a meeting of the Deutsche Arbeiterpartei, joining as the 55th member, and later seizing control of the state requires intelligence. Landing in a dingy yacht with 81 men, bleeding a regime to death, and ruling it until your death requires intelligence. Buying the rights to the Quick and Dirty Operating System, licensing it to IBM, and becoming the de facto standard OS for all consumer computing requires intelligence. Presenting yourself as a folksy Texan when you&#x27;re a private-school elite from Connecticut and convincing the electorate that you&#x27;d have a beer with them requires intelligence. All of these outcomes are goals, and accomplishing them demonstrates an ability to actually put the rubber to the road.<p>You&#x27;re confusing the technical term of intelligence, which means something along the lines of &quot;ability to accomplish goals,&quot; with the social construct of &quot;intelligence&quot; which means something along the lines of &quot;ability to impress people.&quot; Intelligence is not always impressive, and humans have a fantastic ability to write off the accomplishments of others when they want to make the world appear more just. I mean, nobody feels good about the fact that we&#x27;re one Napoleon away from a totally different world system that may or may not suit our interests. The belief that the world is somehow fundamentally different to the extent that the next Napoleon-class intelligence who isn&#x27;t content managing a hedge fund and just increasing an int in a bank database can&#x27;t actually redraw the world map, is just an illusion we tell ourselves to make the world we live in more fair, the stories we live out more meaningful, and the events of our lives have a little bit more importance.<p>AI could change things very, very drastically. It&#x27;s right to be afraid.