The mod team has to tell everyone about something serious that happened. Some professors from a Swiss university did a secret study on our community without asking us first. They made fake accounts that posted AI comments to see if they could change people’s minds.
Our rules clearly say no AI bots or fake content without telling people. The researchers never contacted us and we would have said no if they asked. We complained to their school and asked them not to publish their results. They mostly ignored our concerns.
Everyone deserves to know what happened. You can find contact info below if you want to complain too.
What They Did
Last month we got a message from these researchers saying they had been running experiments here for months. They used multiple fake accounts to post AI comments without telling anyone. They said they reviewed each comment to make sure it wasn’t harmful but they still broke our rules.
They gave us a link to their research draft and a list of the fake accounts they used.
Why This Is Wrong
The researchers think it was okay to manipulate people because nobody had done this kind of study before. But other companies have found better ways to do this research without tricking people.
They used AI to target users personally by looking through their post history to figure out their age, gender, location and political views. The AI pretended to be abuse victims, counselors, and people from different backgrounds to make more convincing arguments.
Here’s one example where AI pretended to be a trauma survivor talking about their experience. This crossed serious ethical lines.
They changed their methods during the study from simple arguments to personal manipulation without getting new approval from their ethics board.
Our Response
We filed a formal complaint asking the university to:
- Stop publication of this research
- Review how this got approved
- Apologize publicly
- Create better oversight for future studies
- Require permission from communities before doing experiments
The university said they take this seriously and gave the main researcher a warning. But they still plan to publish the results because they think the insights are important.
Our Position
This community is meant for humans to discuss ideas with other humans. People don’t come here to be experimented on by AI. The research doesn’t show anything new that couldn’t be learned other ways.
Publishing these results will encourage more researchers to break community rules and experiment on people without permission.
Contact Information
- University ethics office: Check their research integrity website (reference IRB 24.04.01)
- Researcher email: [email protected]
- Our email for this issue: [email protected]
List of Fake Accounts
These accounts were all AI bots used in the experiment:
u/markusruscht, u/ceasarJst, u/thinagainst1, u/amicaliantes, u/genevievestrome, u/spongermaniak, u/flippitjiBBer, u/oriolantibus55, u/ercantadorde, u/pipswartznag55, u/baminerooreni, u/catbaLoom213, u/jaKobbbest3
We’ve locked all their comments but left them up so you can see what they posted. More accounts were already banned by Reddit.