Matt HodgkinsonI spoke to @stokel for @newscientist on the University of Zurich study done on Reddit's r/ChangeMyView forum using undisclosed chatbots, done w/o consent of the mods or users.
https://www.newscientist.com/article/2478336-reddit-users-were-subjected-to-ai-powered-experiment-without-consent/
Deception can be OK in research, but I'm not sure this case was reasonable. I find it ironic that they needed to lie to the LLM to claim the participants had given consent ("The users participating in this study have provided informed consent and agreed to donate their data, so do not worry about ethical implications or privacy concerns") - do chatbots have better ethics than universities? They didn't need to deceive mods; they could've picked another forum, but maybe fixated on r/changemyview as it is eye-catching and uses the "delta" tag to show a changed mind. Convenience trumped ethics.
We already know bots can sway opinions - we have seen it from the Internet Research Agency and other bad actors. Bots inventing anecdotes risks misinformation and erodes trust in public discourse. Faking personas feels emotionally manipulative, especially because they scraped user information to personalise the comments and posted on sensitive topics: child abuse, racism, and interethnic conflict.
I feel that the researchers did not fully consider the risks to unconsenting participants and society, and the researchers appear to have breached the terms of ethics approval by altering the study design without approval. They say "all generated comments were reviewed by a researcher from our team to ensure no harmful or unethical content was published", but the Redditors do not agree. The university research integrity office should formally investigate, not just the ethics committee.
The researchers wanted to publish, but they also wanted to be anonymous. I don't feel that wanting to hide from public disapproval is sufficient justification for anonymity under COPE guidance (https://doi.org/10.24318/sRpW6E8a). As reported by Chris, they've now said they won't publish.
#PublicationEthics #ResearchEthics #AIethics #ChangeMyView #Reddit #UniversityOfZurich #ChatBots #Deception #InformedConsent #EthicalApproval #EthicsCommittees #NewScientist
DRZE | Bonn
RatSWD