The Dark Side of AI: Large-Scale Scam Campaigns Made Possible by Generative AI

Rapid advancements in AI have enabled large language models (LLMs) and generative technologies to fuse their outputs, creating a new level of diverse, synthetic content that can deceive on an unprecedented scale. This chilling union of AI capabilities opens the door to the generation of entire scam campaigns, blurring the boundary between reality and fiction. Many people are already aware of how LLMs (such as OpenAI’s ChatGPT, Google’s Bard, and Meta’s Llama 2) can help with basic writing and coding. In this webinar, we go beyond simple LLM-assisted ploys and demonstrate automatically orchestrated credential-stealing scam campaigns that combine code, text, images, and audio to build dozens of websites, product catalogs, testimonials, and social media advertisements. We discuss how the barriers to entry have decreased for criminals with minimal knowledge of AI, the scale that automation can achieve, and the current shortcomings that still require human intervention. Don’t miss Sophos X-Ops Ben Gelman take a turn toward the dark side—demonstrating how generative AI can be used to automate the creation of campaigns to steal users’ credentials and other personal information.