Hugging Face Releases Agents
I'm not 100% sure that AGI is guaranteed to end humanity like Yudkowsky, but if that's the course we're on, seeing news like this is depressing.  Can anyone legitimately argue that LLMs are safe because they don't have agency, when we just straight up give them agency?  I know current-generation LLMs aren't really dangerous -- but is this not likely to happen over and over again as our machine intelligences get smarter and smarter?  someone is going to give them the ability to affect the world.  They won't even have to try to "get out of the box", because it'll have 2 sides missing.I'm getting more and more on board with "shut it all down" being the only course of action, because it seems like humanity needs all the safety margin we can get, to account for the ease at which anyone can deploy stuff like this.  It's not clear alignment of a super-intelligence is even a solvable problem.