The emergence of ubiquitous, powerful generative artificial intelligence (AI) poses a potential national security threat to the United States, expanding adversary capability for malign influence operations on social media. Of particular concern is a potentially revolutionary improvement in astroturfing: Adversaries can create a false perception of widespread grassroots support for an issue or person, manufacturing fake but seemingly human accounts on Twitter, Facebook, or other platforms to advance narratives serving the interests of those governments. China and Russia are already engaged in astroturfing, but the advent of generative AI makes it more convincing, ultimately posing a direct challenge to democratic societies.
To address this potential national security threat, the U.S. government and industry should consider pursuing technical, policy, and diplomatic mitigation strategies now. Any mitigation strategy must account for generative AI being ubiquitous and unregulated.
What is generative AI? Generative AI is an umbrella term for AI models that can produce media based on user-generated text prompts. Large language models (such as OpenAI’s GPT-3) and text-to-image models (such as Stable Diffusion) are the most mature and most deployable, but the ability to create convincing video, audio, and music is rapidly maturing.
How does generative AI change social media manipulation? Generative AI removes many of the limitations of prior generations of social media manipulation. The new technology can produce remarkably human-like interactions, with much less labor, thereby saving costs and making such manipulation scalable; its “authenticity” makes it harder to detect fake content.
Generative AI is a dream come true for China, especially the Chinese military. The People’s Liberation Army (PLA) is likely a key actor in Chinese social media manipulation, and PLA researchers have hailed generative AI as improving their capabilities for what they call “cognitive domain operations.” One PLA researcher, Li Bicheng, has worked since at least 2019 to develop an AI-run botnet that is well-positioned to harness generative AI to create its content. However, the Chinese Communist Party is also likely worried that generative AI will enable better adversary (U.S.) information operations to undermine its rule—an enduring fear.
Taiwan provides a notional illustration of how generative AI can be a game-changer for Chinese social media manipulation.