In early 2021, a freewheeling, freethinking group of investors on Reddit decided to flex some collective muscle. They plowed their money into GameStop, a video game retailer that several big hedge funds had bet against. The stock price shot up, some people made millions—and, to the delight of those on Reddit, the hedge funds had some very bad days.
Hollywood turned this all into comedy with the 2023 movie Dumb Money. But researchers at RAND also saw the GameStop story as a cautionary tale. If investors on Reddit could work together to move the markets like that, what could an adversary like China do?
The researchers started looking for other emerging or understudied threats to the U.S. financial system. In a recent report, they warned that the greatest danger is not a single, sudden attack, a financial 9/11. It's the constant assault on reality—the deepfake videos and manipulated AI—that could weaken the financial system over time. It will be slow, but it will be steady and hard to stop—more like financial climate change.
“There are so many players in the markets, and they all have to interact and coordinate in specific ways for the markets to work,” said Tobias Sytsma, an associate economist at RAND who led the study. “When you throw sand into those gears, all of a sudden the markets get less efficient and can start to break down. And when that happens, it impacts not just financial sectors, but households. People's savings disappear. It impacts all of society.”
Which threats to the financial system should we be paying closer attention to?
Share on TwitterThe researchers convened focus groups at RAND. They interviewed experts in government, academia, and industry. Their main question was always the same: Which threats to the financial system should we be paying closer attention to? They came away with four answers.
- Social engineering by meme. This is the GameStop story, weaponized. An adversary could flood social media with memes to create a frenzy around a particular stock or sector. Prices would rise—but then could come crashing back down, wiping out fortunes and destabilizing the broader market.
- Attacks on AI. Around 80 percent of U.S. stock trades are executed by algorithm. Experiments have shown that tweaking as little as one word in the data fed into an investment model can wreck its performance over time. An adversary could try to target major financial institutions by leaving poisoned crumbs of data on social media for computers to scrape up and ingest.
- Deepfakes. AI can now generate audio and video clips that are so realistic many people can't tell that they're fake. A few years ago, scammers mimicked the voice of a European CEO—down to his faint German accent—and tricked his colleague into wiring them $243,000. Adversaries could use deepfakes to compromise major companies or business leaders. They could also fan economic crises or controversies with fake outrages.
- Bond dumping. China holds more than $800 billion in U.S. Treasury bonds. It could, in theory, dump them in an effort to rock U.S. markets and drive up interest rates. That would briefly make it more expensive for the U.S. to borrow money. With perfect timing, that could—again, in theory—trip up the U.S. response to a Chinese provocation, such as a move on Taiwan.
Photo by hocus-focus/Getty Images
None of these is going to bring the financial system to its knees anytime soon. But that's not necessarily the point. All of them could make the markets seem a little less safe, a little less secure. They could undermine public trust and reinforce the idea that what we think is real might just be a deepfake or a cleverly orchestrated meme campaign. That would worsen one of our great national maladies, a condition RAND calls “Truth Decay,” the diminishing role of facts and analysis in public life.
“It comes back to this idea of trust in each other, trust in the markets, trust in institutions,” Sytsma said. “That trust is actually critical to how markets function. When you start to lose that, you run the risk of greater market volatility and greater market losses.”
The experts RAND consulted were divided over how much danger these threats actually pose right now. AI manipulation? Possible. Meme campaigns? At least feasible. Bond dumping? “Highly improbable,” the researchers concluded. Russia and China toyed with the idea during the 2008 financial crisis. But China buys U.S. bonds to support its growth and bolster its currency. Dumping U.S. bonds now would be like shooting its own economy in the legs.
But deepfakes? Those already represent a “significant risk” to financial markets, the experts warned. One good deepfake video could briefly disrupt the market, they concluded. But a coordinated campaign of deepfakes could cause deeper and more-lasting harm—measured not just in trust, but in dollars.
Last year, for example, a photograph started spreading on social media that appeared to show an explosion at the Pentagon. Officials debunked it as a fake almost immediately. But the S&P 500 still dropped by .3 percentage points in a matter of minutes, a loss of potentially billions of dollars. And that was just from a photograph.
Advances in AI are making it much cheaper and easier to produce convincing deepfakes. Efforts to counter them are advancing as well; a model developed by Intel looks for biological markers like blood flow to separate real humans in videos from computer-generated fakes. But, for now, the deepfakers have the edge. In a 2020 competition, the winning deepfake-detection model got it right just 65 percent of the time.
Financial regulators have taken steps in recent years to protect the markets against deepfakes and other threats. They have called for greater monitoring of meme stocks, for example, and warned that too many institutions rely on the same AI models, leaving them all open to manipulation. They have sought to prevent sudden market swings by instituting “circuit breakers” that shut down trading when index losses exceed 7 percent.
But more could be done, the researchers wrote. Stronger policies against the misuse of AI in general could provide important safeguards for the market. More research into how Truth Decay could corrode financial systems would also help. But the threats are always evolving and advancing. The researchers recommended periodic exercises—economic wargames—to look for vulnerabilities and test whether existing defenses still hold.
That is a potentially $2.7 trillion concern. That's what a 7 percent market loss would look like before the circuit breakers can kick in and stop the damage.