Industry change

OpenAI disrupts AI-enabled 'false front' influence operations

Published
Source
OpenAI blog

Summary

OpenAI reported banning two covert influence operations, one traced to Russia and one to Iran, that used its models to support fake front organizations. The Iranian operation pitched long-form articles to online outlets through seven fake 'journalist' personas, while the Russian operation ran a disguised think tank in Latin America and spread fabricated 'leaked' documents. OpenAI assessed the Russia-origin campaign as Category 5 on the Breakout Scale, the first such rating among the 30 operations it has exposed since early 2024. The company noted AI mainly made traditional influence workflows faster and more fluent.

Why it matters for our work

The report shows AI-generated content can reach mainstream media through fake identities and outlets, not just social feeds. For companies and researchers, source verification and media literacy become baseline defenses in the AI era.

Translated from the Korean original. Summaries may be translated and edited. Commentary reflects our perspective; forecasts remain the source’s views.

Read original (opens in a new tab)