57There are some possible edge-cases here where a system is getting information via channels other than
those the designers intended, but I’ll leave these to the side. The point here is that we’re interested in how the
system responds to inputs, not in how the world might change the system into something else.

58Though here, too, lines may get hard to draw.
59See Yudkowsky on the “omnipotence test for AI safety”: “The Omni Test is that an advanced AI should be
expected to remain aligned, or not lead to catastrophic outcomes, or fail safely, even if it suddenly knows all
facts and can directly ordain any possible outcome as an immediate choice. The policy proposal is that, among
agents meant to act in the rich real world, any predicted behavior where the agent might act destructively if given

16
Is Power-Seeking AI an Existential Risk?