Great article covering a lot of good topics. Especially the overpromise-&gt;winter effect and the fact that lots of whats in AI&#x27;s are nonsense. My favorite part was this though:<p>&quot;The truth is that the part that causes the problem is the actuator. It&#x27;s the interface to physicality. &quot;<p>BOOM! That was my exact argument in counterpoints to Superintelligence risks. I thought it was ridiculous to worry about what it thought when you could easily control what it <i>did</i> at the interface. I also pointed out that high assurance security already has decades of work dealing with this exact problem and pretty effectively. So, anyone worried about that sort of things should focus on securing the interface that would be used in various domains to catch issues.<p>Now, that&#x27;s not to say a superintelligence can&#x27;t break an evil scheme down into a series of safe actions that result in catastrophe. There&#x27;s possibilities there. Just that all methods for handling them can and should be at the interface. And can be implemented by verifiable, dumb algorithms.