The challenge of (1) is to use what methods in this respect are available to ensure PS-alignment
on all inputs in X. But note that because available methods change, (1) is a moving target: new
techniques and capabilities open up new options. I emphasize this because sometimes the challenge
of AI alignment is framed as one of shaping an AI’s objectives in a particular way—for example,
via hand-written code, or via some sort of reward signal, or via English-language sentences that will
be interpreted in literalistic and uncharitable terms. And this can make it seem like the challenge is
centrally one of, e.g., coding, measuring, or articulating explicitly everything we value, or getting
Is Power-Seeking AI an Existential Risk?