• Current AI systems are, I think, some combination of non-agentic-planning and strategically
unaware. Some of this is clearly a function of what we are currently able to build, but it may
also be a clue as to what type of systems will be most economically important in future.

• To the extent that agentic planning and strategic awareness create risks of the type I discuss

below, this might incentivize focus on other types of systems.37

• Agentic planning and strategic awareness may constitute or correlate with properties that
ground moral concern for the AI system itself (though not all actors will treat concerns about
the moral status of AI systems with equal weight; and considerations of this type could be
ignored on a widespread scale).
Is Power-Seeking AI an Existential Risk?