Reddit Cracks Down After AI Bots Secretly Infiltrated Debate Forum

By: decrypt|2025/05/09 07:15:01
0
Share
copy
Reddit Cracks Down After AI Bots Secretly Infiltrated Debate Forum Reddit plans to tighten verification processes after researchers used AI to manipulate users' opinions without consent. In brief Reddit is fast-tracking new user verification measures to ensure participants are human while still maintaining anonymity. Third-party verification services will be used to confirm humans without compromising users' personal information. The move comes after a group of researchers used AI bots to change opinions on a subreddit dedicated to healthy debates. Decrypt’s Art, Fashion, and Entertainment Hub. Behind the scenes in one of Reddit's largest communities, something creepy has been brewing. For four months, AI-powered bots masqueraded as humans, swaying opinions and earning thousands of upvotes. The experiment appeared to be working— until everyone found out . Reddit announced plans earlier this week to tighten user verification after learning that researchers from the University of Zurich conducted an unauthorized experiment on the r/changemyview subreddit, using AI bots to manipulate users without their knowledge or consent. The researchers had deployed the bots, which used sensitive personas—including trauma counselors, sexual assault survivors, and controversial political identities—from late 2024 to early 2025, and posted over 1,700 comments. The AI entities also analyzed users' posting histories to craft persuasive, personalized responses—all without disclosing that they were AI agents. In a post to the community, Reddit's Chief Legal Officer Ben Lee condemned the experiment as "deeply wrong on both a moral and legal level," citing violations of the platform's user agreement and research ethics. The company has banned all accounts linked to the research and filed formal complaints with the University of Zurich. Keeping Reddit human means sharing more info "Reddit works because it's human," CEO Steve Huffman wrote in a recent platform update . "It’s one of the few places online where real people share real opinions... If we lose trust in that, we lose what makes Reddit... Reddit." The experiment hit at the heart of what makes online communities function: trust. Moderators described it as " psychological manipulation ," noting that users join the subreddit expecting genuine human interactions, not to be unwitting test subjects. That said, the AI bots were remarkably effective, collecting over 20,000 upvotes and 137 "deltas"—awards given when someone successfully changes another user's view. However, the experiment only gained steam after the researchers revealed their work. To prevent another incident—even a secret one—Reddit is now fast-tracking measures to verify that users are human without compromising privacy. "To keep Reddit human and to meet evolving regulatory requirements, we are going to need a little more information," Huffman explained. "Specifically, we will need to know whether you are a human, and in some locations, if you are an adult. But we never want to know your name or who you are." The company plans to partner with third-party verification services to conduct such checks. Huffman emphasized that maintaining anonymity remains a cornerstone of the platform: "Anonymity is essential to Reddit. We have been—and will continue to be—extremely protective of your personal information." While Reddit already uses AI tools for tasks like content moderation and spam filtering, the company has set a limit when it comes to bots impersonating users. "Our focus is, and always will be, on keeping Reddit a trusted place for human conversation," Huffman affirmed. The platform currently bans "bad" bots, but the incident highlighted critical vulnerabilities in the current system. As AI becomes increasingly sophisticated, distinguishing between human and machine-generated content presents mounting challenges for online communities. Reddit didn’t reply to a request for comment, but Reddit user Apprehensive_Song490, who serves as a moderator at r/changemyview, told Decrypt that interactions with AI for research purposes would be carefully examined by the moderators. “My general impression is that the team is always receptive to researchers and that we would consider requests on a case-by-case basis,” he said. As Reddit approaches its 20th anniversary, the incident underscores a pivotal moment for the platform and similar online communities . The challenge ahead lies in harnessing AI's benefits while preserving the human connection that makes these spaces valuable in the first place. "The internet is changing rapidly, and human perspectives have never been more important," Huffman noted. "No solution is perfect—including the status quo—but we will do our best to preserve both the humanness and anonymity of Reddit.” Edited by James Rubin Generally Intelligent Newsletter

You may also like

On-chain finance: On-chain IPOs and on-chain ICOs, a new frontier in the trillion-dollar market

The United States uses stablecoins to export the dollar, uses on-chain IPOs/ICOs to export assets, and uses OnFi to export financial rules.

Rented Belief: How Much of the Bitcoin ETF Fund Flow is Real Money

Looking at it week by week, the ETF capital flow is mainly driven by a hidden arbitrage trade rather than belief.

The two giants are racing in "credit": loan balances of 9.9 billion vs 14.6 billion USD, Brazil has become the main battlefield

When we see the domestic credit market growing slowly, with major lending platforms and consumer finance companies tightening their strategies and cautiously controlling their volumes; in stark contrast, the overseas credit sector is迎来 a period of rapid expansion.

A company that was on the verge of bankruptcy has just surpassed Bitcoin in market value

In this wave of AI, capital is clearly more inclined to pay a premium for segments that have real orders, visible supply bottlenecks, and quantifiable profits, which also puts the Crypto AI narrative under more direct scrutiny regarding the certainty of value realization.

B.AI partners with MiniMax to launch a limited-time free experience of M3, enabling zero-threshold implementation of Agentic productivity through full-stack infrastructure

B.AI and MiniMax launch a limited-time free offer for M3, allowing access to top-tier large model core computing power with no threshold.

The second half of the computing power battle: Intel CEO Pat Gelsinger reveals how AI is reshaping the global semiconductor supply chain

Intel CEO Pat Gelsinger's latest discussion: The AI computing power battle has gone beyond the single-point competition of GPUs; the ultimate trump card is to comprehensively restructure the semiconductor supply chain and solve the systemic bottlenecks in advanced manufacturing.
iconiconiconiconiconiconicon
Customer Support:@weikecs
Business Cooperation:@weikecs
Quant Trading & MM:bd@weex.com
VIP Program:support@weex.com