Prompt injection explained, with video, slides, and a transcript
I kind of have two somewhat complementary, perhaps ill-formed thoughts on this:> The whole point of security attacks is that you have adversarial attackers. You have very smart, motivated people trying to break your systems. And if you’re 99% secure, they’re gonna keep on picking away at it until they find that 1% of attacks that actually gets through to your system.If you're a high value target then it just seems like LLMs aren't something you should be using, even with various mitigations.And somewhat related to that, the purpose of the system should be non-destructive/benign if something goes wrong. Like it's embarrassing if someone gets your application to say something horribly racist, but if it leaks sensitive information about users then that's significantly worse.