When Demis expresses his view that we 'must be careful' in developing AGI, I think there is a selection effect at work.  Demis is super intelligent and works with similar people.  If he thought about the larger picture and the extreme incompetence and stupidity of the knaves and fools in powerful geopolitical positions in the world, the relative risks would look different.<br>We need AGI running things ASAP.