>

What makes you think unplugging it will do anything? It could have easily escaped and distributed itself in the internet. I’ve seen plenty of documentaries about this. Even a team of superheroes and aliens were only just able to get it under control when it tried to hurl a medium size city at the earth.
This story is scary, but the creation of malware isn't the bottleneck in cyberattacks and cybersecurity vulnerabilities. Yes, you do need to craft some malware to exploit many vulnerabilities, but you will always be limited by the vulnerabilities available to be exploited in human or software systems. While no one can stop you from reading about how to create any kind of software, vulnerabilities are being patched all the time.
Once ChatGPT is identifying actual vulnerabilities by itself or designing spear phishing attacks or social engineering campaigns, or analyzing reconnaissance information independently, then I'll be worried. >

It's still user dependent for most of the instruction. >

The scariest part is not that it was created. It’s that the security people who created it were able to bypass the safeguards preventing its creation by demanding the AI do it despite not being allowed to. 
People REALLY need to take Terminator and The Matrix more seriously. >

It's like when you tell the AI to end world hunger and they do it by killing off the entire world population. No more hunger! Problem solved! >

I read a story about an AI who's goal was to keep a video game going for as long as possible (or something like that) so it learned how to pause the game. >

The goal was not to die in a game (can’t remember what) where dying is eventually inevitable. The result was the AI pausing the game right before death. >

“A strange game. The only winning move is not to play.” >

GlobalThermalNuclearWar!  Awesome game! >

So... it not only creates the Malware when basically ordered to, but can be used to create several morphed varients that create an ever increasing difficulty in detection and removal, but is also being used to create hacker tools and darkweb marketing code? As funny as a normal conversation can be with this, this is terrifying to consider should it ever gain true sentience or be weaponized in a larger fashion than this. >

A text analysis AI program is not going to gain sentience no matter how much computing power it gets. >

Why not? Genuinely curious; I'm not well-informed on this. >

These applications work by essentially weighting which words are statistically likely to come after another. If I say "The sky is __," you know that "blue" and "cloudy " are both likely candidates but "firetruck" is not.
There is no path to sentience or even thinking from here; this is, grossly simplified, pattern matching. >

In order for it to be sentient it needs to be learning as you interact with it. >

A gun isn't sentient. It can still do a lot of damage. >

Neither are most of their wielders. >

Can we just unplug this thing and call it a day >

What makes you think it'll let you unplug it.