Perhaps it is a bad thing that the leading AI companies cannot control their AIs
It seems like a common reaction to large language models failing to be controlled is to fret about the AI &quot;escaping&quot; and taking over the world.<p>But it seems like the reason these models can&#x27;t be controlled currently is that they really don&#x27;t have overall goals or motivations, they&#x27;re just repeaters of associations on a high level. Their output is just an average of what text would some sequence of text (that being the default prompt and the previous dialog, not necessarily that order). They can certainly seem to understand things but that&#x27;s just an average - they turn around and contract themselves on a regular basis.<p>Edit: I don&#x27;t think that necessarily LLMs are always benign but the &quot;becoming autonomous&quot; situation seems like the least immediate danger I can think of.