Don&#x27;t focus on one scenario leading to disaster. There are many scenarios pointing roughly in the same direction. Here&#x27;s the argument in its shortest form:<p>The current situation, where unmodified humans are the smartest creatures around and call the shots, is unstable. It could go several different ways depending on the desires and quirks of the first superhuman intelligence to appear. It could happen via math-based AI, nature-imitating AI, self-improving mind uploads, biological intelligence amplification, or other means. We&#x27;re making fast progress on all these fronts, so I&#x27;d be surprised if at least one of those didn&#x27;t happen within the next century, possibly much sooner. Since it&#x27;s an arms race between many competing organizations, it&#x27;s unrealistic to expect that all superhuman intelligences will be kept powerless. So one way or another, it will happen. How do we ensure that humanity and its values survive the transition?