>

So... it not only creates the Malware when basically ordered to, but can be used to create several morphed varients that create an ever increasing difficulty in detection and removal, but is also being used to create hacker tools and darkweb marketing code? As funny as a normal conversation can be with this, this is terrifying to consider should it ever gain true sentience or be weaponized in a larger fashion than this.
This story is scary, but the creation of malware isn't the bottleneck in cyberattacks and cybersecurity vulnerabilities. Yes, you do need to craft some malware to exploit many vulnerabilities, but you will always be limited by the vulnerabilities available to be exploited in human or software systems. While no one can stop you from reading about how to create any kind of software, vulnerabilities are being patched all the time.
Once ChatGPT is identifying actual vulnerabilities by itself or designing spear phishing attacks or social engineering campaigns, or analyzing reconnaissance information independently, then I'll be worried. >

It's still user dependent for most of the instruction. >

The scariest part is not that it was created. It’s that the security people who created it were able to bypass the safeguards preventing its creation by demanding the AI do it despite not being allowed to. 
People REALLY need to take Terminator and The Matrix more seriously. >

It's like when you tell the AI to end world hunger and they do it by killing off the entire world population. No more hunger! Problem solved! >

I read a story about an AI who's goal was to keep a video game going for as long as possible (or something like that) so it learned how to pause the game. >

The goal was not to die in a game (can’t remember what) where dying is eventually inevitable. The result was the AI pausing the game right before death. >

“A strange game. The only winning move is not to play.” >

GlobalThermalNuclearWar!  Awesome game!