<i>I know you don&#x27;t particularly subscribe to the &quot;AGI is extremely dangerous&quot; line of thinking</i><p>I think the question in my mind is &quot;dangerous to who and when?&quot;<p>Is AGI an existential threat? Probably. But on what time horizon? Through what mechanism? And can we evolve and collaborate with AGI instead of de-facto competing with it?<p>None of the AGI warning people (Bostrom, Yudkowski, Barrat et al.) have come up with a plausible chain of events that leads to human irrelevance or extinction. They always make a few assumptions and then claim &quot;and then exponential growth happens&quot; and boom everyone&#x27;s a paperclip.<p>The USG doesn&#x27;t have a position at this point and it&#x27;s ill prepared to react. In reality if there is some kind of world ending gray goo scenario that an AGI creates - nothing the US or any other Government can do will matter. I think that&#x27;s about as likely as Roko&#x27;s Basilisk being true though (eg. 0% chance).