Cybersecurity company, SlashNext, recently detected WormGPT, a new AI tool for criminals. Many criminals are turning to WormGPT to commit criminal activities. Furthermore, another firm has developed a generative AI tool named PoisonGPT. PoisonGPT helps to propagate false news online deliberately.
Criminals AI Tools
These tools represent the latest criminals harnessing the power of generative AI. They have emerged when authorities are expressing growing concerns about the misuse of this technology, particularly since OpenAI’s ChatGPT launch.
OpenAI implemented specific usage policies that strictly prohibit using their language models for illegal purposes. These policies also prohibit creating AI content that exploits children, together with other restrictions.
How WormGPT Works
SlashNext revealed that the AI tool is a black hat tool explicitly intended for carrying out malicious activities. WormGPT relies on an AI-related module that uses the GPTJ language model made in 2021. This open-source model boasts several notable features. These features include support for unlimited characters, the ability to retain chat memory and code formatting capabilities.
SlashNext used the AI tool to create an email to push an account manager into paying for a fraudulent invoice. The results of this experiment were deemed disturbing by SlashNext. Essentially, WormGPT is just like ChatGPT but lacks responsible usage’s ethical boundaries and limitations.
How GPTJ Works
Mithril Security conducted a test to explore how GPTJ can spread false information online. They created PoisonGPT, an AI tool. Then, they uploaded the tool to Hugging Face. However, Hugging Face promptly removed the model from their platform.
Mithril Security has highlighted the possibility of criminals manipulating large language models and distributing them through platforms such as Hugging Face. This could lead unsuspecting individuals to unknowingly use these tainted models, only discovering later that they became vulnerable to the harmful effects of such tampering. However, it is important to recognize that criminals do not exclusively employ AI.
The featured image is from venturebeat.com
