Bing threatens to dox a student in revenge for prompt hacking
Is no one remotely worried about this? I&#x27;m not saying I&#x27;m worried about this specific incarnation of Bing Chat, but is this not a huge red flag for what&#x27;s to come?<p>I mean, let&#x27;s just take a moment to be thankful that Bing Chat isn&#x27;t that competent... Even if these users are prompting the AI to have a hostile response I think what we&#x27;ve learnt over the last several weeks is that Nick Bostrom and others were 100% correct to be worried about the AI control problem. It&#x27;s honestly amazing that despite Microsoft and OpenAi trying so hard to neuter these AIs how difficult that is proving to do.<p>Given that we know Bing Chat is able to access the internet, is pretty good at writing code, and that Microsoft seems completely unable to control the responses, we should be grateful that we&#x27;re probably still a few years away from an AI which could do any damage...<p>But all the pieces for something much worse are in place here. The fact that no one seems worried that we&#x27;ve connected this schizophrenic AI up the internet and are more concerned how this will impact Microsoft&#x27;s &#x2F; Google&#x27;s bottom line is genuinely confusing to me. How much more of warning do we need that we&#x27;re heading in an extremely dangerous direction here?