Not an impossible scenario, it all depends on who trains and operates future AI. Before we reach this level of autonomy and capability, will be plenty of advance warning with simpler models that act in mischievous ways and get easily caught. Humanity can develop safety protocols such as NOT giving AIs access to thermonuclear arsenals, similar to the current safety regulations to mitigate bad human behavior.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence