AlphaStar to play even better Starcraft, or to make me lots of money on the stock market, or to help me ﬁnd
love). And “catastrophic” seems both too broad (not all catastrophic behavior scales in the problematic way
power-seeking does, nor is it clear why catastrophic behavior would imply power-seeking) and too narrow (not
all relevant power-seeking need be “catastrophic” on its own, especially pre-deployment, and/or in “multipolar”
scenarios in which no one AI actor is dominant).
Is Power-Seeking AI an Existential Risk?