Yoshua Bengio: How Rogue AIs May Arise
> Corporations may be viewed as special kinds of artificial intelligences whose building blocks (humans) are cogs in the machine (who for the most part may not always perceive the consequences of the corporation’s overall behavior)> Now imagine AI systems like corporations that (a) could be even smarter than our largest corporations and (b) can run without humans to perform their actions (or without humans understanding how their actions could contribute to a nefarious outcome)Wait - but it’s those very corporations who currently control the most powerful AI on the planet - so in a sense this is an argument that we already have rogue AI. Corporations with goals that are not aligned with society, not controlled by any individual and outside the effective control of government entities, who now provide essentially unlimited compute and human researcher/programmer resources to improve the AI. Who’s in control? Nobody.